Image sensor and imaging device

Abstract

To provide an imaging element and an imaging device that generate an image signal on the basis of an output signal from the imaging element and perform focus detection using a phase difference method without providing a pixel for focus detection in the imaging element.SOLUTION: In a camera body of a digital camera, am imaging element 12 includes a plurality of microlenses 40 arranged two-dimensionally, and multiple pixels (R pixel, G pixel, B pixel) that receive light of different color components provided for each of the microlens 40, and pixels that receive light of the same color component provided in adjacent microlenses 40 among the plurality of microlenses 40 are arranged adjacently.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to an image pickup device and an imaging apparatus.

Background Art

[0002] An imaging apparatus that performs focus detection by a pupil division type phase difference method based on output signals from a plurality of pixels dedicated to focus detection arranged in a part of an image pickup device is known (see Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the prior art, focus detection is limited to the position where pixels dedicated to focus detection are arranged. However, if the number of pixels dedicated to focus detection is increased, an image signal cannot be obtained at the position where the pixels dedicated to focus detection are arranged, resulting in a deterioration in image quality. Thus, in the prior art, while it is possible to perform focus detection by a phase difference method in addition to generating an image signal based on the output signal of the image pickup device, there has been a drawback due to providing pixels dedicated to focus detection in a part of the image pickup device.

Means for Solving the Problems

[0005] According to a first aspect of the present invention, the image sensor includes a first filter into which light transmitted through a first microlens is incident and which has a first spectral characteristic; a second filter into which light transmitted through the first microlens is incident and which has a second spectral characteristic; a third filter into which light transmitted through a second microlens located next to the first microlens in a first direction is incident and which has the second spectral characteristic; a fourth filter into which light transmitted through the second microlens is incident and which has the first spectral characteristic; a fifth filter into which light transmitted through a third microlens located next to the first microlens in a second direction intersecting the first direction is incident and which has the first spectral characteristic; a sixth filter into which light transmitted through the third microlens is incident and which has the second spectral characteristic; and the first filter A first photoelectric conversion unit that converts light transmitted through a filter into an electric charge; a second photoelectric conversion unit that converts light transmitted through a second filter into an electric charge and is located next to the first photoelectric conversion unit in the first direction; a third photoelectric conversion unit that converts light transmitted through a third filter into an electric charge and is located next to the second photoelectric conversion unit in the first direction; a fourth photoelectric conversion unit that converts light transmitted through a fourth filter into an electric charge and is located next to the third photoelectric conversion unit in the first direction; a fifth photoelectric conversion unit that converts light transmitted through a fifth filter into an electric charge and is located next to the first photoelectric conversion unit in the second direction; and a sixth photoelectric conversion unit that converts light transmitted through a sixth filter into an electric charge and is located next to the second photoelectric conversion unit in the second direction and next to the fifth photoelectric conversion unit in the first direction. at least, A first floating diffusion into which the charge converted in the first photoelectric conversion unit and the charge converted in the fifth photoelectric conversion unit are transferred, at least, The system includes a second floating diffusion to which the charge converted in the second photoelectric conversion unit, the charge converted in the third photoelectric conversion unit, and the charge converted in the sixth photoelectric conversion unit are transferred. According to a second aspect of the present invention, the imaging device comprises an image sensor according to the first aspect. [Effects of the Invention]

[0006] According to the present invention, it is possible to generate an image signal and perform focus detection using a phase difference method based on the output signal from the image sensor, without providing a dedicated pixel for focus detection on the image sensor. [Brief explanation of the drawing]

[0007] [Figure 1] This figure illustrates the configuration of a digital camera according to an embodiment of the present invention. [Figure 2] This is a plan view illustrating the arrangement of pixels in an image sensor. [Figure 3] This diagram illustrates the exit pupil of a replacement lens. [Figure 4] This diagram illustrates the pixel sequence used to determine the amount of defocus. [Figure 5] This diagram illustrates the beam of light passing through the exit pupil. [Figure 6] This diagram illustrates the pixel sequence used to determine the amount of defocus. [Figure 7] This diagram illustrates the beam of light passing through the exit pupil. [Figure 8] This diagram illustrates the pixel sequence used to determine the amount of defocus. [Figure 9] This diagram illustrates the beam of light passing through the exit pupil. [Figure 10] This diagram illustrates the first image signal generation process. [Figure 11] This diagram illustrates the second image signal generation process. [Figure 12] This diagram illustrates the third image signal generation process. [Figure 13] This diagram illustrates the third image signal generation process. [Figure 14] This diagram illustrates the third image signal generation process. [Figure 15] This diagram illustrates the third image signal generation process. [Figure 16] This diagram illustrates the third image signal generation process. [Figure 17] It is a flowchart for explaining the flow of imaging processing. [Figure 18] It is a diagram for explaining the image signal generation process of Modification 6. [Figure 19] It is a diagram illustrating the circuit configuration of an image sensor. [Figure 20] It is a plan view illustrating the arrangement of circuits in an image sensor. [Figure 21] (a) is a diagram illustrating the incident surface of an image sensor, and (b) is a diagram illustrating the wiring surface of an image sensor. [Figure 22] It is a diagram illustrating the connection between an image sensor and a signal processing chip.

Embodiments for Carrying Out the Invention

[0008] Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. FIG. 1 is a diagram illustrating the configuration of a digital camera according to an embodiment of the present invention. The digital camera 1 is composed of an interchangeable lens 2 and a camera body 3. The interchangeable lens 2 is attached to the camera body 3 via a mount portion 4.

[0009] The interchangeable lens 2 includes a lens control unit 5, a main lens 9, a zoom lens 8, a focusing lens 7, and an aperture 6. The lens control unit 5 is composed of a microcomputer and a memory, etc., and performs drive control of the focusing lens 7 and the aperture 6, detection of the aperture state of the aperture 6, position detection of the zoom lens 8 and the focusing lens 7, transmission of lens information to the body control unit 14 on the camera body 3 side described later, reception of camera information from the body control unit 14, etc.

[0010] The camera body 3 includes an image sensor 12, an image sensor drive control unit 19, a body control unit 14, a liquid crystal display element drive circuit 15, a liquid crystal display element 16, an eyepiece lens 17, and an operation member 18, etc., and a detachable memory card 20 is attached. The image sensor 12 is arranged at the planned imaging plane of the interchangeable lens 2 and images the subject image imaged by the interchangeable lens 2.

[0011] The body control unit 14 consists of a microcomputer and memory, etc. The body control unit 14 controls the operation of the entire digital camera. The body control unit 14 and the lens control unit 5 are configured to communicate via the electrical contacts 13 of the mount unit 4.

[0012] The image sensor drive control unit 19 generates the necessary control signals for the image sensor 12 in response to instructions from the body control unit 14. The liquid crystal display element drive circuit 15 drives the liquid crystal display elements 16 that constitute the liquid crystal viewfinder (EVF: electronic viewfinder) in response to instructions from the body control unit 14. The photographer observes the image displayed on the liquid crystal display elements 16 through the eyepiece lens 17. The memory card 20 is a storage medium for storing image data and other data.

[0013] The subject image formed on the image sensor 12 by the interchangeable lens 2 is photoelectrically converted by the image sensor 12. The timing (frame rate) of accumulating and reading out the photoelectric conversion signal of the image sensor 12 is controlled by a control signal from the image sensor drive control unit 19. The output signal from the image sensor 12 is converted into digital data by an A / D conversion unit (not shown) and sent to the body control unit 14.

[0014] The body control unit 14 calculates the amount of defocus based on the output signal corresponding to a predetermined focus detection area from the image sensor 12 and sends this amount of defocus to the lens control unit 5. The lens control unit 5 calculates the focusing lens drive amount based on the amount of defocus received from the body control unit 14 and drives the focusing lens 7 to the focus position using a motor (not shown) or the like based on this lens drive amount.

[0015] Furthermore, the body control unit 14 generates image data for recording based on the signal output from the image sensor 12 after the shooting command is issued. The body control unit 14 stores the generated image data in the memory card 20 and also sends it to the liquid crystal display element driving circuit 15, which then displays it on the liquid crystal display element 16.

[0016] The camera body 3 is equipped with an operating component 18, which includes a shutter button and a focus detection area setting component. The body control unit 14 detects operation signals from these operating components 18 and controls operations (such as shooting and setting the focus detection area) according to the detection results.

[0017] <Image sensor description> This embodiment is characterized by the image sensor 12, so the following description will focus on the image sensor 12. Figures 2(a) and (b) are plan views illustrating the arrangement of pixels in the image sensor 12. Here, 10 × 10 pixels are shown as representative. Each pixel is laid out in a roughly square shape and arranged in a two-dimensional manner. There are three types of pixels: pixels that receive red light (R pixels), pixels that receive green light (G pixels), and pixels that receive blue light (B pixels).

[0018] The R pixel consists of a color filter that transmits only red light and a photoelectric conversion unit located behind the color filter. The G pixel consists of a color filter that transmits only green light and a photoelectric conversion unit located behind the color filter. The B pixel consists of a color filter that transmits only blue light and a photoelectric conversion unit located behind the color filter.

[0019] Furthermore, the image sensor 12 has multiple microlenses 40 formed therein to efficiently guide the light beam from the interchangeable lens 2 to the set of four pixels. In Figure 2, the 5x5=25 circles correspond to the microlenses 40. The microlenses 40 are composed of, for example, axially symmetric spherical or aspherical lenses whose centers coincide with the optical axis, and are arranged in a two-dimensional manner with the light incident side being convex.

[0020] Behind each microlens 40, one R pixel, two G pixels, and one B pixel are arranged in a 2x2 grid. In this explanation, as shown in Figure 2(a), the sets of four pixels located behind the microlens 40 are classified into four types (P1 to P4) based on their arrangement.

[0021] Behind the microlens 40, in the first set P1, the R pixel is positioned in the upper left, the G pixel in the upper right, the G pixel in the lower left, and the B pixel in the lower right. In the second set P2, the G pixel is positioned in the upper left, the R pixel in the upper right, the B pixel in the lower left, and the G pixel in the lower right. In the third set P3, the G pixel is positioned in the upper left, the B pixel in the upper right, the R pixel in the lower left, and the G pixel in the lower right. In the fourth set P4, the B pixel is positioned in the upper left, the G pixel in the upper right, the G pixel in the lower left, and the R pixel in the lower right.

[0022] The first set P1 and the second set P2 are adjacent to each other horizontally (in the X direction) and are arranged alternately in a repeating pattern horizontally. The column formed by the first set P1 and the second set P2 is called the first column L1. The third set P3 and the fourth set P4 are adjacent to each other horizontally and are arranged alternately in a repeating pattern horizontally. The column formed by the third set P3 and the fourth set P4 is called the second column L2.

[0023] The first column L1 and the second column L2 are adjacent in the vertical direction (Y direction) and are arranged alternately in the vertical direction. As a result, each first set P1 and the third set P3 are adjacent in the vertical direction, and each second set P2 and the fourth set P4 are adjacent in the vertical direction.

[0024] With this arrangement, the positional relationship between the microlens 40 and the R, G, and B pixels is as follows:

[0025] First, the R pixels are positioned behind four adjacent microlenses 40 in the vertical and horizontal directions, at the top left, top right, bottom left, and bottom right, respectively. The G pixels are positioned behind four adjacent microlenses 40 in the vertical and horizontal directions, at the top right and bottom left, top left and bottom right, top left and bottom right, top right and bottom left, respectively. The B pixels are positioned behind four adjacent microlenses 40 in the vertical and horizontal directions, at the bottom right, bottom left, top right, and top left, respectively. In this way, the R, G, and B pixels are evenly distributed behind the microlenses 40 so as not to be biased towards any particular position.

[0026] Figure 2(b) is a diagram showing the same area as in Figure 2(a). When the four pixel groups (P1~P4) shown in Figure 2(a) are shifted by one pixel vertically and horizontally, as shown in Figure 2(b), the R, G, and B pixels are arranged such that adjacent 2x2 rows of 4 pixels are of the same color.

[0027] Furthermore, the four pixels of the same color arranged in two rows and two columns are each positioned behind a different microlens 40, and their positions relative to the microlens 40 are all different. In other words, the R, G, and B pixels, each positioned behind one of the four different microlenses 40, are arranged adjacent to each other in two rows and two columns for each color.

[0028] The above-mentioned set 50r, consisting of four R pixels arranged in two rows and two columns of the same color, set 50g, consisting of four G pixels, and set 50b, consisting of four B pixels, form a Bayer array when viewed as a set of four pixels.

[0029] <Focus detection processing> Next, an example of acquiring a focus detection signal from the image sensor 12 with the above configuration will be explained using Figures 3 to 9. Figure 3 is a diagram illustrating the exit pupil 80 of the interchangeable lens 2 with the aperture 6 open. The light beam that passes through the four regions 81 to 84 of the exit pupil 80 is incident on the pixels located in the upper left, upper right, lower left, and lower right of the microlens 40 in Figure 2, respectively. The correspondence between the light beam incident on the pixels located in the upper left, upper right, lower left, and lower right of each microlens 40 and the first region 81, second region 82, third region 83, and fourth region 84 can be considered as an inversion of the image vertically and horizontally with respect to the optical axis Ax of the interchangeable lens 2. Note that Figure 3 is a diagram illustrating the concept. In reality, the configuration is such that light passing through the microlens 40 is incident on pixels included in adjacent pairs, preventing color mixing and a decrease in resolution.

[0030] First, as illustrated in Figure 4, we will explain the case in which the amount of defocus is determined based on a pixel array 90 in which the G pixels of the image sensor 12 are arranged horizontally (in the X-axis direction). The pixel array 90 consists of a G pixel (Ga) located in the upper left of the microlens 40, which is included in the second set P2, and a G pixel (Gb) located in the upper right of the microlens 40, which is included in the first set P1. As illustrated in Figure 5, a light beam A passing through the first region 81 on the exit pupil 80 and a light beam B passing through the second region 82 are incident on the pixels constituting the pixel array 90. Light beam A is incident on the G pixel (Ga) located in the upper left of the microlens 40. Light beam B is incident on the G pixel (Gb) located in the upper right of the microlens 40.

[0031] When in focus, a sharp image is formed on the image sensor 12, and as described above, the pair of images produced by the light beams divided into pupils at different pupil positions coincide on the image sensor 12. In other words, in the pixel row 90, the signal waveforms obtained from the G pixels (Ga) receiving light beam A (signal rows a1, a2, a3, a4…) and the signal waveforms obtained from the G pixels (Gb) receiving light beam B (signal rows b1, b2, b3, b4…) have overlapping shapes.

[0032] On the other hand, when the image is out of focus, a sharp image is formed in front of the image sensor 12, or behind the image sensor 12. Therefore, the pair of images produced by the pupil-divided light beams do not coincide on the image sensor 12. In this case, the signal waveforms from light beam A (signal train a1, a2, a3, a4…) and the signal waveforms from light beam B (signal train b1, b2, b3, b4…) have different relative positions (direction and amount of deviation) depending on the deviation from the focused state (amount of defocus).

[0033] The body control unit 14 calculates the adjustment state of the focal position by the interchangeable lens 2 (defocus amount) based on the positional relationship of the signal waveforms from light beam A (signal sequence a1, a2, a3, a4…) and the signal waveforms from light beam B (signal sequence b1, b2, b3, b4…), and transmits the calculation result as camera information to the lens control unit 5. When the lens control unit 5 moves the focusing lens 7 forward and backward in the optical axis direction based on the camera information, the focus is adjusted so that a sharp image is formed on the image sensor 12.

[0034] Next, we will explain the case in which the amount of defocus is determined based on a pixel array 120 in which the G pixels of the image sensor 12 are arranged vertically (in the Y-axis direction), as illustrated in Figure 6. The pixel array 120 consists of a G pixel (Ga) located in the upper left of the microlens 40, which is included in the second set P2, and a G pixel (Gc) located in the lower left of the microlens 40, which is included in the fourth set P4. As illustrated in Figure 7, a light beam A passing through the first region 81 on the exit pupil 80 and a light beam C passing through the third region 83 are incident on the pixels constituting the pixel array 120. Light beam A is incident on the G pixel (Ga) located in the upper left of the microlens 40. Light beam C is incident on the G pixel (Gc) located in the lower left of the microlens 40.

[0035] When in focus, a sharp image is formed on the image sensor 12. As described above, in the pixel array 120, the shapes of the signal waveforms obtained from the G pixels (Ga) that receive light beam A (signal array a1, a2, a3, a4…) and the signal waveforms obtained from the G pixels (Gc) that receive light beam C (signal array c1, c2, c3, c4…) overlap.

[0036] On the other hand, when the image is out of focus, the signal waveforms from light beam A (signal sequence a1, a2, a3, a4…) and the signal waveforms from light beam C (signal sequence c1, c2, c3, c4…) have different relative positions (direction and amount of deviation) depending on the deviation from the focused state (amount of defocus).

[0037] The body control unit 14 calculates the adjustment state of the focal position by the interchangeable lens 2 (defocus amount) based on the positional relationship of the signal waveforms from light beam A (signal sequence a1, a2, a3, a4…) and the signal waveforms from light beam C (signal sequence c1, c2, c3, c4…), and transmits the calculation result as camera information to the lens control unit 5. When the lens control unit 5 moves the focusing lens 7 forward and backward in the optical axis direction based on the camera information, the focus is adjusted so that a sharp image is formed on the image sensor 12.

[0038] Furthermore, as illustrated in Figure 8, we will explain the case in which the amount of defocus is determined based on a pixel array 150 in the image sensor 12 in which G pixels are arranged diagonally. The pixel array 150 is composed of a G pixel (Ga) located in the upper left and a G pixel (Gd) located in the lower right of the microlens 40, which are included in the second set P2, and a G pixel (Ga) located in the upper left and a G pixel (Gd) located in the lower right of the microlens 40, which are included in the third set P3. As illustrated in Figure 9, a light beam A passing through the first region 81 on the exit pupil 80 and a light beam D passing through the fourth region 84 are incident on the pixels constituting the pixel array 150. Light beam A is incident on the G pixel (Ga) located in the upper left of the microlens 40. Light beam D is incident on the G pixel (Gd) located in the lower right of the microlens 40.

[0039] When in focus, a sharp image is formed on the image sensor 12. As described above, in the pixel array 150, the shape of the signal waveform obtained from the G pixels (Ga) that receive light beam A (signal array a1, a2, a3, a4…) and the signal waveform obtained from the G pixels (Gd) that receive light beam D (signal array d1, d2, d3, d4…) overlaps.

[0040] On the other hand, when the image is out of focus, the signal waveforms from light beam A (signal sequence a1, a2, a3, a4…) and the signal waveforms from light beam D (signal sequence d1, d2, d3, d4…) have different relative positions (direction and amount of deviation) depending on the deviation from the focused state (amount of defocus).

[0041] The body control unit 14 calculates the adjustment state of the focal position by the interchangeable lens 2 (defocus amount) based on the positional relationship of the signal waveforms from light beam A (signal sequence a1, a2, a3, a4…) and the signal waveforms from light beam D (signal sequence d1, d2, d3, d4…), and transmits the calculation result as camera information to the lens control unit 5. When the lens control unit 5 moves the focusing lens 7 forward and backward in the optical axis direction based on the camera information, the focus is adjusted so that a sharp image is formed on the image sensor 12.

[0042] <Image signal generation processing> Next, an example of acquiring an image signal from the image sensor 12 will be explained using Figures 10 to 16. In this embodiment, the image signal generation process that generates a color image signal based on the output signal from the image sensor 12 is performed using one of the following three methods. The body control unit 14 performs the image signal generation process using the method instructed in advance by the initial settings.

[0043] (First image signal generation process) Figure 10 is a diagram illustrating the first image signal generation process. The body control unit 14, which performs the first image signal generation process, treats four pixels that receive a light beam through the same microlens 40 as a set 200, as shown in Figure 10(a). Each set 200 contains two G pixels, one B pixel, and one R pixel.

[0044] The body control unit 14 takes the output signal from the R pixel as the R image signal for each set 200, the output signal from the B pixel as the B image signal for the set 200, and the average value of the output signals from the two G pixels as the G image signal for the set 200. As a result, the body control unit 14 can obtain a color image signal (RGB) with 1 / 4 the number of pixels contained in the image sensor 12, as shown in Figure 10(b). The body control unit 14 generates a recording image file using the color image signal obtained in this way.

[0045] Thus, in the first image signal generation process, a color image signal can be obtained without performing color interpolation processing to interpolate the color signals.

[0046] (Second image signal generation process) Figure 11 is a diagram illustrating the second image signal generation process. The body control unit 14 that performs the second image signal generation process treats four adjacent pixels of the same color arranged in two rows and two columns as a single set 210, as shown in Figure 11(a).

[0047] The body control unit 14 uses the sum of the output signals from the four pixels included in each set 210 as the image signal for that set 210. Specifically, in the case of a set 210 of red pixels, the body control unit 14 uses the sum of the output signals from the four red pixels as the R image signal for that set 210. In the case of a set 210 of green pixels, the body control unit 14 uses the sum of the output signals from the four green pixels as the G image signal for that set 210. In the case of a set 210 of blue pixels, the body control unit 14 uses the sum of the output signals from the four blue pixels as the B image signal for that set 210. As a result, the body control unit 14 can obtain an image signal with a Bayer array that has 1 / 4 the number of pixels included in the image sensor 12, as shown in Figure 11(b).

[0048] Incidentally, depending on the angle of incidence of the light beam incident on the microlens 40, the amount of light received by the four pixels located behind the microlens 40 may not be equal. For example, at a certain angle of incidence θ1, the pixel located in the upper left of the microlens 40 receives a large amount of light, while the pixel located in the lower right of the microlens 40 receives a small amount of light. At a different angle of incidence θ2, the pixel located in the upper left of the microlens 40 receives a small amount of light, while the pixel located in the lower right of the microlens 40 receives a large amount of light.

[0049] In the second image signal generation process, the output signals from four pixels (i.e., the four pixels included in each set 210) located at different positions on the microlens 40 (upper left, upper right, lower left, and lower right) are added together to form the image signal. This makes it possible to generate an appropriate image signal regardless of the angle of incidence of light to the microlens 40.

[0050] The body control unit 14 further generates missing color components in the Bayer array image signal by interpolation using signals from adjacent pairs 210. For example, in the case of a G pixel pair 210, since there are no R and B image signals, color interpolation is performed using signals from surrounding pairs 210. Since such color interpolation in a Bayer array is well known, a detailed explanation is omitted. The body control unit 14 generates a recording image file using the color image signal (RGB) obtained by this color interpolation.

[0051] (Third image signal generation process) The body control unit 14, which performs the third image signal generation process, first performs color interpolation processing to interpolate the missing color components in each pixel.

[0052] Figure 12 illustrates the process of interpolating the G image signal. The body control unit 14 generates a G image signal by interpolation at the position of each R pixel and B pixel using the output signals from the four G pixels located closest to that pixel. For example, when interpolating the G image signal at the position of the R pixel shown in the thick frame in Figure 12(a), the output signals from the four G pixels (G1 to G4) located closest to this R pixel are used. The body control unit 14 uses (αG1 + βG2 + γG3 + δG4) / 4 as the G image signal for the R pixel. Note that α to δ are coefficients corresponding to the distance from the R pixel, and the closer the distance from the R pixel, the larger the coefficient. In this case, G pixels G1 and G2 are closer to the R pixel than G pixels G3 and G4, so α = β > γ = δ.

[0053] In this way, the body control unit 14 performs interpolation of the G image signal at the positions of the R and B pixels, thereby obtaining the G image signal at the position of each pixel 30, as shown in Figure 12(b).

[0054] Figure 13 illustrates the interpolation process for the R image signal and the B image signal. As shown in Figure 13(a), the body control unit 14 treats four adjacent pixels of the same color arranged in two rows and two columns as a single set 220, and adds the output signals from these four pixels to obtain the image signal for that set 220. Each set 220 forms a Bayer array as shown in Figure 13(b). The body control unit 14 performs interpolation processing on the R image signal and the B image signal for each set 220 using a known color interpolation process for Bayer arrays. As a result of this interpolation processing, an R image signal is obtained for each set 220 as shown in Figure 14(a), and a B image signal is obtained for each set 220 as shown in Figure 15(a).

[0055] The body control unit 14 converts the resolution by dividing the interpolated R image signal in each set 220 by 4 (R / 4) and using this as the R image signal for the four pixels constituting each set 220. As a result, the body control unit 14 can obtain an R image signal at the position of each pixel 30, as shown in Figure 14(b). Similarly, the body control unit 14 converts the resolution by dividing the interpolated B image signal in each set 220 by 4 (B / 4) and using this as the B image signal for the four pixels constituting each set 220. As a result, the body control unit 14 can obtain a B image signal at the position of each pixel 30, as shown in Figure 15(b).

[0056] The body control unit 14 performs the color interpolation process described above to obtain RGB image signals at the location of each pixel 30, as shown in Figure 16(a). The body control unit 14 then uses the RGB image signals at the location of each pixel to obtain a luminance signal Y at the location of each pixel 30. For example, the body control unit 14 uses 0.299R + 0.587G + 0.114B as the luminance signal Y.

[0057] Furthermore, at the position of each pixel 30, the body control unit 14 uses the signal obtained by subtracting the luminance signal Y from the R image signal (RY) as the color difference signal Cr. At the position of each pixel 30, the body control unit 14 uses the signal obtained by subtracting the luminance signal Y from the B image signal (BY) as the color difference signal Cb.

[0058] As a result, the body control unit 14 can obtain a luminance signal Y and chrominance signals Cr and Cb at the position of each pixel 30, as shown in Figure 16(b). The body control unit 14 uses the color image signal (YCrCb) obtained in this way to generate a file of the image to be recorded.

[0059] <Image Processing> Figure 17 is a flowchart illustrating the flow of the shooting process performed by the body control unit 14. When the main switch (not shown) that constitutes the operating member 18 is turned ON, the body control unit 14 starts photoelectric conversion at a predetermined frame rate in the image sensor 12, sequentially reproduces and displays the through image based on the image signal on the liquid crystal display element 16, and starts a program that performs the processing exemplified in Figure 17. The through image is a monitor image acquired before the shooting command.

[0060] In step S11 of Figure 17, the body control unit 14 determines whether or not a shooting instruction has been given. If the release button, which constitutes the operating member 18, is pressed, the body control unit 14 affirms step S11 and proceeds to step S12. If the release button is not pressed, the body control unit 14 negates step S11 and proceeds to step S18.

[0061] In step S18, the body control unit 14 determines whether time has run out or not. If a predetermined time (for example, 5 seconds) has been measured, the body control unit 14 determines step S18 to be positive and terminates the process shown in Figure 17. If the measured time is less than the predetermined time, the body control unit 14 determines step S18 to be negative and returns to step S11.

[0062] In step S12, the body control unit 14 performs AE processing and AF processing. In AE processing, exposure calculations are performed based on the level of the image signal for the through image, and the aperture value AV and shutter speed TV are determined to obtain proper exposure. In AF processing, the focus is adjusted by performing the focus detection processing described above based on the output signal sequence from the pixel sequence included in the set focus detection area. After performing the above AE and AF processing, the body control unit 14 proceeds to step S13.

[0063] In step S13, the body control unit 14 performs the shooting process and proceeds to step S14. Specifically, it controls the aperture 6 based on AV and causes the image sensor 12 to perform photoelectric conversion for recording based on the storage time based on TV. In step S14, the body control unit 14 uses the output signal from the image sensor 12 to perform the image signal generation process described above and performs predetermined image processing (grayscale conversion, edge enhancement, white balance adjustment, etc.) on the obtained image signal. After performing the image processing, the body control unit 14 proceeds to step S15.

[0064] In step S15, the body control unit 14 displays the captured image on the liquid crystal display element 16 and proceeds to step S16. In step S16, the body control unit 14 generates an image file for recording and proceeds to step S17. In step S17, the body control unit 14 records the image file to the memory card 20 and terminates the process shown in Figure 17.

[0065] According to the embodiments described above, the following effects can be obtained. (1) The digital camera 1 comprises an image sensor 12 that captures an image of a subject using the subject light beam that has passed through the interchangeable lens 2, a body control unit 14 that generates an image signal based on the output signal from the image sensor 12, and a body control unit 14 that detects the focus adjustment state of the interchangeable lens 2 using a phase difference detection method based on the output signal from the image sensor 12. The image sensor 12 has a pixel group and a microlens group arranged to guide the subject light beam to the pixel group. The pixel group has R pixels, B pixels, and G pixels arranged in two dimensions, each having different first, second, and third spectral sensitivities. Behind each microlens 40 of the microlens group, one R pixel, one B pixel, and two G pixels are arranged in two rows and two columns. These four pixels are the four pupil regions of the exit pupil 80 of the interchangeable lens 2. The image sensor receives four light beams A to D passing through regions 81 to 84, and the R, B, and G pixels are arranged adjacent to each other in a 2x2 arrangement with pixels having approximately the same spectral sensitivity (i.e., pixels of the same color). The four adjacent pixels in this 2x2 arrangement are each positioned behind four different microlenses 40, and their positions relative to the microlenses 40 are different. The body control unit 14 generates an image signal based on the output signals from the R, B, and G pixels, and the body control unit 14 detects the focus adjustment state based on the output signal from the G pixel. As a result, the image sensor 12 can generate an image signal and perform phase-difference focus detection based on the output signal of the image sensor 12 without providing a dedicated pixel for focus detection.

[0066] (2) In the digital camera 1 described in (1) above, the R pixels are configured to have a red color filter, the B pixels to have a blue color filter, and the G pixels to have a green color filter, so that red, green, and blue color image signals can be obtained from the output signal of the image sensor 12.

[0067] (3) In the digital camera 1 described in (2) above, the pixel group is formed by arranging sets of 4 pixels in a 2x2 grid behind a single microlens 40 in a two-dimensional arrangement, and the set has four sets P1 to P4, each with a different pixel arrangement, where in the first set P1 R pixels and G pixels are arranged adjacent to each other horizontally, and in the vertical direction G pixels and B pixels are arranged adjacent to the R pixels and G pixels, respectively; in the second set P2 G pixels and R pixels are arranged adjacent to each other horizontally, and in the vertical direction B pixels and G pixels are arranged adjacent to the G pixels and R pixels, respectively; in the third set P3 G pixels and B pixels are arranged adjacent to each other horizontally, and in the vertical direction R pixels and G pixels are arranged adjacent to the G pixels and B pixels, respectively. In the fourth set P4, B pixels and G pixels are arranged adjacent to each other horizontally, and G pixels and R pixels are arranged adjacent to the B pixels and G pixels, respectively, vertically. The first set P1 and the second set P2 are adjacent to each other horizontally and are arranged alternately in a repeating pattern horizontally. The third set P3 and the fourth set P4 are adjacent to each other horizontally and are arranged alternately in a repeating pattern horizontally. The first column L1 formed by the first set P1 and the second set P2 and the second column L2 formed by the third set P3 and the fourth set P4 are adjacent to each other vertically and are arranged alternately in a repeating pattern vertically. As a result, focus detection using the phase difference method can be performed based on the output signal of the image sensor 12, and any of the first to third image signal processing described above can be performed.

[0068] (4) In the digital camera 1 described in (2) or (3) above, the body control unit 14 is configured to generate a Bayer array image signal (i.e., perform the second image signal generation process) by adding the output signals from four R pixels adjacent to each other in a 2x2 arrangement, adding the output signals from four B pixels adjacent in a 2x2 arrangement, and adding the output signals from four G pixels adjacent to each other in a 2x2 arrangement. Therefore, an appropriate image signal can be generated regardless of the angle of incidence of light to the microlens 40. Furthermore, in the color interpolation process, an existing image processing engine that performs color interpolation in a Bayer array can be used.

[0069] (5) In the digital camera 1 described in (1) to (3) above, the body control unit 14 is configured to acquire three color signals at each microlens 40 position (i.e., perform the first image signal generation process) based on the output signals from the R, B, and G pixels positioned behind each microlens 40, so that a color image signal can be acquired without performing color interpolation.

[0070] (6) In the digital camera 1 described in (1) to (3) above, the body control unit 14 is configured to acquire three color signals by performing color interpolation processing at each pixel position of the R pixel, B pixel, and G pixel to generate signals for the other two spectral components, and to generate a luminance signal and a color difference signal based on these three color signals (i.e., to perform the third image signal generation processing described above), thereby enabling the acquisition of a high-resolution image signal.

[0071] (7) In the digital camera 1 described in (1) to (6) above, the body control unit 14 is configured to detect the focus adjustment state of the interchangeable lens 2 based on output signals from a pair of pixels in the pixel group that have substantially the same spectral sensitivity and are located at different positions relative to the microlens 40. Therefore, the focus adjustment state can be appropriately detected by the phase difference method based on the output signal from the image sensor 12.

[0072] (8) In the digital camera 1 described in (3) above, the body control unit 14 is configured to detect the focus adjustment state of the interchangeable lens 2 in the horizontal direction based on the output signals from the G pixels included in the first set P1 and the second set P2, respectively. Therefore, based on the output signal from the image sensor 12, the focus adjustment state of the image sensor 12 can be appropriately detected in the horizontal direction of the image sensor 12 using a phase difference method.

[0073] (9) In the digital camera 1 described in (3) above, the body control unit 14 is configured to detect the focus adjustment state of the interchangeable lens 2 in the vertical direction based on the output signals from the G pixels included in the second set P2 and the fourth set P4, respectively. Therefore, based on the output signal from the image sensor 12, the focus adjustment state of the image sensor 12 can be appropriately detected in the vertical direction by a phase difference method.

[0074] (10) In the digital camera 1 described in (3) above, the body control unit 14 is configured to detect the focus adjustment state of the interchangeable lens 2 in an oblique direction with respect to the horizontal direction based on the output signals from the G pixels included in the second set P2 and the third set P3, respectively. Therefore, based on the output signal from the image sensor 12, the focus adjustment state of the image sensor 12 can be appropriately detected in an oblique direction using the phase difference method.

[0075] (Variation 1) In the embodiment described above, focus detection processing is performed using the output signal from the G pixel, but focus detection processing may also be performed using the output signal from the R pixel or B pixel.

[0076] The body control unit 14 in Modification 1 is configured to determine an AWB (Auto White Balance) evaluation value using the output signal from the image sensor 12. The AWB evaluation value is, for example, the integrated value of the output signals for each R pixel, G pixel, and B pixel. If the integrated value in the G pixel is low, it may not be possible to properly calculate the amount of defocus using the output signal from the G pixel. Therefore, the body control unit 14 in Modification 1 performs the focus detection processing described above using the R pixel or B pixel with the larger integrated value when the integrated value in the G pixel is below a predetermined threshold. This makes it possible to perform focus detection processing appropriately even when photographing a subject with a small G component.

[0077] (Modification 2) In the embodiment described above, the image signal for recording is generated using the process specified in the initial settings among the first to third image signal generation processes, but the embodiment is not limited to this.

[0078] For example, in Modification 2, the body control unit 14 selects a first image signal generation process that can generate an image signal without performing color interpolation when displaying a through image, and generates the image signal using the selected first image signal generation process. On the other hand, for images to be recorded, it selects a third image signal generation process that can generate a high-resolution image signal, and generates the image signal using the selected third image signal generation process. In this way, when generating an image signal, the body control unit 14 of Modification 2 can select one of the first, second, or third image signal generation processes, allowing it to choose an image signal generation process suitable for the intended use of the image to be generated. For example, it can select the first image signal generation process, which does not require color interpolation, when it is desired to display an image in real time, and select the third image signal process when it is desired to record an image in high quality.

[0079] Furthermore, the body control unit 14 may generate image signals for moving images using a first or second image signal generation process, and generate image signals for still images using a third image signal generation process.

[0080] Furthermore, the body control unit 14 may generate an image signal using both the first and second image signal generation processes, for example. In this case, the body control unit 14 displays both the image generated by the first image signal generation process and the image generated by the second image signal generation process on a rear display device (not shown). The body control unit 14 records the image selected by the user via the operating member 18 from the two displayed images onto the memory card 20.

[0081] (Variation 3) In the embodiment described above, the amount of defocus in the horizontal direction is determined based on the output signal sequence from a pixel sequence 90 composed of G pixels (Gb) in the first set P1 and G pixels (Ga) in the second set P2, but it is not limited to this. The amount of defocus in the horizontal direction may be determined based on a pixel sequence composed of G pixels (Gd) in the third set P3 and G pixels (Gc) in the fourth set P4, or the amount of defocus in the horizontal direction may be determined based on both the said pixel sequence and the pixel sequence 90.

[0082] Furthermore, in the above-described embodiment, the amount of defocus in the vertical direction is determined based on the output signal sequence from the pixel sequence 120, which is composed of G pixels (Ga) included in the second set P2 and G pixels (Gc) included in the fourth set P4. However, the embodiment is not limited to this. The amount of defocus in the vertical direction may be determined based on the pixel sequence composed of G pixels (Gb) included in the first set P1 and G pixels (Gd) included in the third set P3, or the amount of defocus in the vertical direction may be determined based on both the said pixel sequence and the pixel sequence 120.

[0083] Furthermore, in the above-described embodiment, the amount of defocus in the oblique direction is determined based on the output signal sequence from the pixel sequence 150, which is composed of G pixels (Ga) and (Gd) included in the second set P2 and G pixels (Ga) and (Gd) included in the third set P3. However, the embodiment is not limited to this. The amount of defocus in the oblique direction may be determined based on the pixel sequence composed of G pixels (Gb) and (Gc) included in the first set P1 and G pixels (Gb) and (Gc) included in the fourth set P4, or the amount of defocus in the oblique direction may be determined based on both the pixel sequence and the pixel sequence 150.

[0084] (Modification 4) In the embodiment described above, the case in which a primary color system (RGB) color filter is used for the image sensor 12 was explained, but a complementary color system (CMY) color filter may also be used.

[0085] (Variation 5) In the embodiments described above, the present invention was applied to a digital camera 1 in which an interchangeable lens 2 is attached to a camera body 3, but the invention is not limited to this configuration. For example, the present invention can also be applied to a digital camera with an integrated lens.

[0086] (Experimental variation 6) In the third image signal generation process of the embodiment described above, the output signals from the four nearest G pixels (G1 to G4) to each R pixel and B pixel are used (Figure 12), but this is not the only option. For example, as shown in Figure 18(a), the output signals from the four nearest G pixels (G5 to G8) located horizontally or vertically to the interpolation target pixel may be used. In this case, the body control unit 14 uses (aG5+bG6+cG7+dG8) / 4 as the G image signal of the interpolation target pixel. a to d are coefficients corresponding to the distance from the interpolation target pixel, and the closer the distance from the interpolation target pixel, the larger the coefficient. In the case of Figure 18(a), a=b>c=d.

[0087] Alternatively, as shown in Figure 18(b), the output signals from four adjacent G pixels (G9 to G12) separated by one pixel horizontally or vertically from the interpolation target pixel may be used. In this case, the body control unit 14 uses (G9 + G10 + G11 + G12) / 4 as the G image signal for the interpolation target pixel, since the distance from the interpolation target pixel is equal for all four G pixels. This simplifies the calculation by eliminating the need for weighting calculations using coefficients.

[0088] Furthermore, the interpolation process shown in Figure 12 may be combined with the interpolation processes shown in Figures 18(a) and (b), or they may be selected according to the amount of computation and interpolation accuracy.

[0089] (Example 7) The image sensor 12 in the above-described embodiment may be configured as a back-illuminated (BSI) type. The configuration of the image sensor 12 in this case will be described below.

[0090] Figure 19 illustrates the circuit configuration of the image sensor 12 in Modification 7. In the image sensor 12 of Modification 7, the circuit is configured with four adjacent pixels of the same color arranged in 2 rows and 2 columns as one set, so Figure 19 illustrates the circuit configuration of one such set.

[0091] Four photodiodes PD (PD1-PD4), each corresponding to one of the four pixels, are connected to the respective sources of four transfer transistors TX (TX1-TX4). The gates of each transfer transistor TX1-TX4 are connected to control lines Cn1-Cn4, each supplying a transfer pulse signal to turn the transfer transistors TX1-TX4 on / off. The drains of each transfer transistor TX1-TX4 are connected in common to the source of the reset transistor RT. The gate of the reset transistor RT is connected to control line Cn5, which supplies a reset pulse signal to turn the reset transistor RT on / off. The so-called floating diffusion FD between the drains of each transfer transistor TX1-TX4 and the source of the reset transistor RT is connected to the gate of the source follower amplifier transistor SF. The drain of the source follower amplifier transistor SF is connected to the source of the selector transistor S. The gate of the selector transistor S is connected to control line Cn6, which supplies a selector pulse signal to turn the selector transistor S on / off. The drain of the selector transistor S is connected to the output line Out.

[0092] The four photodiodes PD1 to PD4 each convert light transmitted through their respective color filters into photoelectric energy to generate signal charge. The signal charge generated by the four photodiodes PD1 to PD4 is transferred to the floating diffusion FD via the corresponding transfer transistors TX1 to TX4. Since the floating diffusion FD is connected to the gate of the source follower amplifier transistor SF, when the selection transistor S is on, the signal corresponding to the potential of the floating diffusion FD is amplified by the source follower amplifier transistor SF and output to the output line Out via the selection transistor S. The reset transistor RT resets the floating diffusion FD by discharging its signal charge.

[0093] Furthermore, since the four photodiodes PD1 to PD4 share the floating diffusion FD, source follower amplifier transistor SF, selection transistor S, and reset transistor RT, the image sensor 12 can output a signal from each individual photodiode PD, or it can output a signal that is the sum of the signals from the four photodiodes PD1 to PD4.

[0094] Figures 20(a) and (b) illustrate the arrangement of the circuits described above in the image sensor 12. In Figure 20(a), an 8x8 pixel area is shown as a representative example. Figure 20(b) is an enlarged view of the portion corresponding to one microlens 40 (2x2 pixels) in Figure 20(a). As shown in Figure 20, the floating diffusion FD, source follower amplifier transistor SF, selection transistor S, and reset transistor RT are not shared by four adjacent 2x2 pixels within one microlens 40, but rather by four adjacent 2x2 pixels of the same color. Therefore, the image sensor 12 can read signals one pixel at a time, or it can read signals that are the sum of four adjacent 2x2 pixels of the same color. Thus, when reading the RGB signals for each microlens 40 in the first image signal generation process described later, it is sufficient to read the signals one pixel at a time from the image sensor 12. Furthermore, in the second image signal generation process described later, if four adjacent pixels of the same color arranged in two rows and two columns are to be treated as a single pixel, then a signal obtained by adding the four adjacent pixels of the same color arranged in two rows and two columns can be read from the image sensor 12.

[0095] Furthermore, in the back-illuminated image sensor 12, a wiring layer is provided on the surface side of the substrate, and a photodiode PD is provided on the back side of the substrate opposite to this wiring layer, and light is incident from the back side of the substrate. Therefore, although Figure 20 shows both the microlens 40 and RGB color filters and the circuit configuration (wiring) for illustrative purposes, in reality, as shown in Figure 21(a), when viewing the image sensor 12 from the light incidence side (back side of the substrate), the microlens 40 and RGB color filters are visible, but the circuit (wiring) is not. As shown in Figure 21(b), when viewing the image sensor 12 from the opposite side of the light incidence side (surface side of the substrate), the circuit (wiring) is visible, but the microlens 40 and RGB color filters are not. In the back-illuminated image sensor 12, the aperture of the photodiode PD is wider compared to conventional surface-illuminated image sensors, so light loss can be reduced, images can be captured with high sensitivity, and the accuracy of the focus detection process described later can be improved.

[0096] Furthermore, the image sensor chip 12 in the modified example 7 can have a stacked structure connected to a signal processing (DSP) chip 70 via bonding members (e.g., microbumps) 60. Figure 22 is a conceptual diagram illustrating the connection between this image sensor 12 and the signal processing chip 70. The image sensor 12 and the signal processing chip 70 are stacked vertically and connected via a number of bonding members 60. The bonding members 60 are provided, for example, for each set of four adjacent pixels of the same color arranged in two rows and two columns as described above on the image sensor 12. Note that in Figure 22, only the portion corresponding to one bonding member 60 is shown for illustrative purposes.

[0097] The signal processing chip 70 is a chip that receives the output from the image sensor 12 and performs signal processing, and includes a circuit 71 that performs correlated double sampling (CDS) and analog-to-digital (A / D) conversion. The signal processing chip 70 may also be provided with memory and arithmetic circuits.

[0098] The signals output from the photodiodes PD1 to PD4 of the image sensor 12 are input to the circuit 71 of the signal processing chip 70 via the bonding member 60, and the circuit 71 performs correlated double sampling (CDS) and analog / digital conversion.

[0099] (Variation 8) The image sensor 12 in the above-described embodiment may be composed of a surface-illuminated image sensor.

[0100] (Extreme variation 9) The image sensor chip 12 in the above-described embodiment may be formed as a single chip with the signal processing chip 70.

[0101] The above description is merely an example and is not limited in any way to the configuration of the embodiment described above. Furthermore, the configurations of each modified example may be combined with the above embodiment as appropriate.

[0102] The disclosures of the following priority application are incorporated herein by reference. Japanese Patent Application No. 081167 of 2012 (filed March 30, 2012)

Claims

1. A first filter into which light transmitted through a first microlens is incident, and which has first spectral characteristics, A second filter into which light transmitted through the first microlens is incident, and which has second spectral characteristics, A third filter having the second spectral characteristics is incident on a filter that receives light transmitted through a second microlens positioned next to the first microlens in a first direction, A filter into which light transmitted through the second microlens is incident, and a fourth filter having the first spectral characteristics, A fifth filter having the first spectral characteristics, into which light transmitted through a third microlens positioned next to the first microlens in a second direction intersecting the first direction is incident, A sixth filter into which light transmitted through the third microlens is incident, and which has the second spectral characteristics, A first photoelectric conversion unit that converts light transmitted through the first filter into electric charge, A photoelectric conversion unit that converts light transmitted through the second filter into an electric charge, the second photoelectric conversion unit being positioned next to the first photoelectric conversion unit in the first direction, A photoelectric conversion unit that converts light transmitted through the third filter into electric charge, the third photoelectric conversion unit being positioned next to the second photoelectric conversion unit in the first direction, A photoelectric conversion unit that converts light transmitted through the fourth filter into an electric charge, the fourth photoelectric conversion unit being positioned next to the third photoelectric conversion unit in the first direction, A photoelectric conversion unit that converts light transmitted through the fifth filter into an electric charge, the fifth photoelectric conversion unit being located next to the first photoelectric conversion unit in the second direction, A photoelectric conversion unit that converts light transmitted through the sixth filter into electric charge, the sixth photoelectric conversion unit being located next to the second photoelectric conversion unit in the second direction and next to the fifth photoelectric conversion unit in the first direction, At a minimum, a first floating diffusion into which the charge converted in the first photoelectric conversion unit and the charge converted in the fifth photoelectric conversion unit are transferred, At least, a second floating diffusion to which the charge converted in the second photoelectric conversion unit, the charge converted in the third photoelectric conversion unit, and the charge converted in the sixth photoelectric conversion unit are transferred. An image sensor equipped with the following features.

2. In the image sensor according to claim 1, A first output unit that outputs a first signal based on the charge transferred to the first floating diffusion, A second output unit that outputs a second signal based on the charge transferred to the second floating diffusion unit. An image sensor equipped with the following features.

3. In the image sensor according to claim 2, The first output section has a first transistor having a gate electrically connected to the first floating diffusion, The second output section has a second transistor having a gate electrically connected to the second floating diffusion. Image sensor.

4. In the image sensor according to claim 2 or claim 3, A first output line is electrically connected to the first output unit and outputs the first signal, The second output line is electrically connected to the second output section and outputs the second signal. An image sensor equipped with the following features.

5. In the image sensor according to claim 4, A first signal processing unit that performs signal processing on the first signal output to the first output line, A second signal processing unit that performs signal processing on the second signal output to the second output line, An image sensor equipped with the following features.

6. In the image sensor according to claim 5, The first signal processing unit includes a first conversion unit that converts the first signal output to the first output line into a digital signal. The second signal processing unit includes a second conversion unit that converts the second signal output to the second output line into a digital signal. Image sensor.

7. In the image sensor according to claim 5 or claim 6, The first signal processing unit includes a first noise reduction unit for removing noise contained in the first signal output to the first output line. The second signal processing unit includes a second noise reduction unit for removing noise contained in the second signal output to the second output line. Image sensor.

8. In the image sensor according to any one of claims 5 to 7, The first photoelectric conversion unit, the second photoelectric conversion unit, the third photoelectric conversion unit, the fourth photoelectric conversion unit, the fifth photoelectric conversion unit, and the sixth photoelectric conversion unit are arranged on the first substrate. The first signal processing unit and the second signal processing unit are arranged on a second substrate laminated with the first substrate. Image sensor.

9. In the image sensor according to claim 8, The first floating diffusion and the second floating diffusion are arranged on the first substrate. Image sensor.

10. In the image sensor according to any one of claims 1 to 9, A seventh filter having the second spectral characteristics, into which light transmitted through a fourth microlens, which is positioned next to the second microlens in the second direction and next to the third microlens in the first direction, is incident; A filter into which light transmitted through the fourth microlens is incident, and an eighth filter having the first spectral characteristics, A photoelectric conversion unit that converts light transmitted through the seventh filter into electric charge, the seventh photoelectric conversion unit being located next to the third photoelectric conversion unit in the second direction and next to the sixth photoelectric conversion unit in the first direction, A photoelectric conversion unit that converts light transmitted through the eighth filter into electric charge, the eighth photoelectric conversion unit being located next to the fourth photoelectric conversion unit in the second direction and next to the seventh photoelectric conversion unit in the first direction, The second floating diffusion transfers the charge converted in the second photoelectric conversion unit, the charge converted in the third photoelectric conversion unit, the charge converted in the sixth photoelectric conversion unit, and the charge converted in the seventh photoelectric conversion unit. Image sensor.

11. In the image sensor according to claim 10, An image sensor comprising a third floating diffusion to which at least the charge converted in the fourth photoelectric conversion unit and the charge converted in the eighth photoelectric conversion unit are transferred.

12. In the image sensor according to claim 11, A first output unit that outputs a first signal based on the charge transferred to the first floating diffusion, A second output unit that outputs a second signal based on the charge transferred to the second floating diffusion, A third output unit that outputs a third signal based on the charge transferred to the third floating diffusion unit, An image sensor equipped with the following features.

13. In the image sensor according to claim 12, The first output section has a first transistor having a gate electrically connected to the first floating diffusion, The second output section has a second transistor having a gate electrically connected to the second floating diffusion, The third output section has a third transistor having a gate electrically connected to the third floating diffusion. Image sensor.

14. In the image sensor according to claim 12 or claim 13, A first output line is electrically connected to the first output unit and outputs the first signal, A second output line is electrically connected to the second output section and outputs the second signal, The third output line is electrically connected to the third output section and outputs the third signal. An image sensor equipped with the following features.

15. In the image sensor according to claim 14, A first signal processing unit that performs signal processing on the first signal output to the first output line, A second signal processing unit that performs signal processing on the second signal output to the second output line, A third signal processing unit that performs signal processing on the third signal output to the third output line, An image sensor equipped with the following features.

16. In the image sensor according to claim 15, The first signal processing unit includes a first conversion unit that converts the first signal output to the first output line into a digital signal. The second signal processing unit includes a second conversion unit that converts the second signal output to the second output line into a digital signal. The third signal processing unit includes a third conversion unit that converts the third signal output to the third output line into a digital signal. Image sensor.

17. In the image sensor according to claim 15 or claim 16, The first signal processing unit includes a first noise reduction unit for removing noise contained in the first signal output to the first output line. The second signal processing unit includes a second noise reduction unit for removing noise contained in the second signal output to the second output line. The third signal processing unit includes a third noise reduction unit for removing noise contained in the third signal output to the third output line. Image sensor.

18. In the image sensor according to any one of claims 15 to 17, The first photoelectric conversion unit, the second photoelectric conversion unit, the third photoelectric conversion unit, the fourth photoelectric conversion unit, the fifth photoelectric conversion unit, the sixth photoelectric conversion unit, the seventh photoelectric conversion unit, and the eighth photoelectric conversion unit are arranged on the first substrate. The first signal processing unit, the second signal processing unit, and the third signal processing unit are arranged on a second substrate laminated with the first substrate. Image sensor.

19. In the image sensor according to claim 18, The first floating diffusion, the second floating diffusion, and the third floating diffusion are arranged on the first substrate. Image sensor.

20. An imaging device comprising an image sensor according to any one of claims 1 to 19.

21. In the imaging device according to claim 20, An imaging device comprising a control unit that is electrically connected to the image sensor and calculates the amount of defocus of the attached optical system.

22. In the imaging apparatus according to claim 20 or claim 21, An imaging device comprising a generation unit that is electrically connected to the image sensor and generates image data.

Images