Imaging element and imaging device

The dual-pixel configuration in the image sensor enables simultaneous readout of image and focus detection signals, improving readout speed and accuracy by using separate signal lines and control mechanisms for AF and imaging pixels.

JP2024160294AActive Publication Date: 2024-11-13NIKON CORP
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2024130118
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2018-03-30
Filing Date
2024-08-06
Publication Date
2024-11-13
Estimated Expiration
2039-03-29

AI Technical Summary

Technical Problem

Existing image sensors face challenges in increasing the speed of signal readout for both image generation and focus detection signals.

Method used

The image sensor employs a dual-pixel configuration with AF pixels and imaging pixels, utilizing separate signal lines and control mechanisms to read out signals from these pixels simultaneously, allowing for parallel processing of image and focus detection signals.

Benefits of technology

This approach enhances the readout speed of AF pixel signals for faster focus detection and improves the accuracy of imaging pixel signals by minimizing variations due to manufacturing differences in readout sections.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024160294000001_ABST
    Figure 2024160294000001_ABST
Patent Text Reader

Abstract

To provide an imaging element.SOLUTION: An imaging element includes: a pixel unit in which first to fourth pixels are arranged along a column direction, the first pixel including a first photoelectric conversion unit and configured to output a first signal used for focus detection, the second pixel including a second photoelectric conversion unit and configured to output a second signal used for the focus detection, the third pixel including a third photoelectric conversion unit and configured to output a third signal used for image generation, the fourth pixel including a fourth photoelectric conversion unit and configured to output a fourth signal used for the image generation; a first signal line; a second signal line; a first readout unit configured to perform signal processing on a signal output to the first signal line; a second readout unit configured to perform signal processing on a signal output to the second signal line; and a vertical control unit configured to perform a first control to control the first pixel and the second pixel so that the first signal and the second signal are output to one of the first signal line and the second signal line, and a second control to control the third pixel and the fourth pixel so that the third signal and the fourth signal are output to the other signal line of the first signal line and the second signal line.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an imaging element and an imaging apparatus. [Background technology]

[0002] Image sensors that read out signals for focus detection and image signals are known (see, for example, Patent Document 1). In such image sensors, there is a demand for faster signal readout. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2017-34606 Summary of the Invention

[0004] According to a first aspect of the invention, an image sensor includes a pixel section in which a first pixel has a first photoelectric conversion unit that converts light transmitted through an optical system into an electric charge and outputs a first signal used for focus detection of the optical system, a second pixel has a second photoelectric conversion unit that converts light transmitted through the optical system into an electric charge and outputs a second signal used for focus detection of the optical system, a third pixel has a third photoelectric conversion unit that converts light transmitted through the optical system into an electric charge and outputs a third signal used for image generation, and a fourth pixel has a fourth photoelectric conversion unit that converts light transmitted through the optical system into an electric charge and outputs a fourth signal used for image generation, the pixel section being arranged in a column direction, a first signal line electrically connectable to the first pixel, the second pixel, the third pixel, and the fourth pixel, and a front pixel. the first readout unit performs signal processing on a signal among the first signal, the second signal, the third signal, and the fourth signal that is output to the first signal line; a second readout unit performs signal processing on a signal among the first signal, the second signal, the third signal, and the fourth signal that is output to the second signal line; and a vertical control unit performs first control to control the first pixel and the second pixel so that the first signal and the second signal are output to one of the first signal line and the second signal line, and second control to control the third pixel and the fourth pixel so that the third signal and the fourth signal are output to a different signal line among the first signal line and the second signal line. According to a second aspect of the invention, an imaging device includes the imaging element according to the first aspect. [Brief description of the drawings]

[0005] [Figure 1] 1 is a block diagram showing a configuration of an imaging device according to a first embodiment. [Diagram 2] FIG. 1 is a diagram illustrating an example of the configuration of an imaging element according to a first embodiment. [Diagram 3] 1 is a diagram illustrating an example of a pixel configuration of an image sensor according to a first embodiment. [Figure 4] FIG. 2 is a diagram illustrating an example of the configuration of a portion of an imaging element according to a first embodiment. [Diagram 5] 4 is a timing chart showing an example of the operation of the imaging element according to the first embodiment. [Figure 6] 1 is a diagram illustrating an example of the configuration of a portion of an imaging element according to a first embodiment. [Figure 7] 5 is a timing chart showing another example of the operation of the imaging element according to the first embodiment. [Figure 8] 5 is a timing chart showing another example of the operation of the imaging element according to the first embodiment. [Figure 9] 11 is a diagram showing an example of the configuration of a portion of an imaging element according to Modification 1. FIG. [Figure 10] 6 is a timing chart showing an example of the operation of the imaging element according to the first modification. [Figure 11] 11 is a diagram showing an example of the configuration of a portion of an imaging element according to Modification 2. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0006] (First embodiment) Fig. 1 is a block diagram showing the configuration of an imaging device according to the first embodiment. Fig. 1 shows an example of the configuration of a camera 1, which is an example of an imaging device according to the first embodiment. Camera 1 includes an imaging optical system (imaging optical system) 2, an imaging element 3, a control unit 4, a memory 5, a display unit 6, and an operation unit 7. The imaging optical system 2 has a plurality of lenses including a focus adjustment lens (focus lens) and an aperture stop, and forms a subject image on the imaging element 3. Note that the imaging optical system 2 may be detachable from the camera 1.

[0007] The imaging element 3 is, for example, a CMOS image sensor. The imaging element 3 receives a light beam that has passed through an exit pupil of the imaging optical system 2, and captures an image of a subject. The imaging element 3 has a plurality of pixels, each having a photoelectric conversion unit, arranged two-dimensionally (for example, in row and column directions). The photoelectric conversion unit is, for example, constituted by a photodiode (PD). The imaging element 3 photoelectrically converts the received light to generate a signal, and outputs the generated signal to the control unit 4.

[0008] The image sensor 3 has imaging pixels and AF pixels (focus detection pixels). The imaging pixels output signals (imaging signals) used for image generation. The AF pixels output signals (focus detection signals) used for focus detection. As will be described later, the AF pixels are arranged by replacing some of the imaging pixels, and are distributed over almost the entire imaging surface of the image sensor 3. In the following description, when simply referring to pixels, this refers to either one or both of the imaging pixels and the AF pixels.

[0009] The memory 5 is a recording medium such as a memory card. Image data and the like are recorded in the memory 5. Writing data to the memory 5 and reading data from the memory 5 are performed by the control unit 4. The display unit 6 displays an image based on the image data, information related to shooting such as the shutter speed and aperture value, a menu screen, and the like. The operation unit 7 includes various setting switches such as a release button and a power switch, and outputs operation signals to the control unit 4 according to the respective operations.

[0010] The control unit 4 is configured with a processor such as a CPU, FPGA, or ASIC, and a memory such as a ROM or RAM, and controls each part of the camera 1 based on a control program. The control unit 4 has an image data generation unit 4a and a focus detection unit 4b. The image data generation unit 4a performs various image processes on the imaging signal output from the imaging element 3 to generate image data. The image processes include known image processes such as tone conversion, color interpolation, and edge enhancement.

[0011] The focus detection unit 4b performs focus detection processing required for automatic focus adjustment (AF) of the imaging optical system 2 by a known phase difference detection method. Specifically, the focus detection unit 4b detects the in-focus position of the focus lens for focusing an image by the imaging optical system 2 on the imaging surface of the imaging element 3. The focus detection unit 4b detects the amount of image shift between the first and second images based on a pair of focus detection signals output from the imaging element 3. The focus detection unit 4b calculates the amount of shift (defocus amount) between the current position of the focus lens and the in-focus position based on the detected amount of image shift. The focus lens is driven according to the defocus amount, thereby automatically performing focus adjustment.

[0012] The control unit 4 controls the image sensor 3 to separately read out signals from pixel rows in which AF pixels are arranged (hereinafter referred to as AF pixel rows) and signals from pixel rows in which AF pixels are not arranged (hereinafter referred to as imaging pixel rows).The control unit 4 also performs a process of sequentially selecting all pixel rows and reading out signals from each pixel, without separately reading out signals from AF pixel rows and imaging pixel rows.

[0013] For example, when displaying a through image (live view image) of a subject on the display unit 6 or when shooting a moving image, the control unit 4 separately reads out the signals of each pixel in the AF pixel row and the signals of each pixel in the imaging pixel row. When shooting a high-resolution still image, the control unit 4 sequentially selects all pixel rows and performs a process of reading out the signals of each pixel.

[0014] 2 is a diagram showing a configuration example of an image sensor 3 according to the first embodiment. The image sensor 3 has a pixel section (pixel region) 100, a vertical control section 30, and a plurality of readout sections 40 (first readout section 40a, second readout section 40b) arranged above and below the pixel section 100. In the pixel section 100 of the image sensor 3, pixels are arranged two-dimensionally (in the row and column directions). Note that the number and arrangement of pixels arranged in the pixel section 100 are not limited to the example shown in the figure. The pixel section 100 may have, for example, millions to hundreds of millions of pixels or more.

[0015] In the pixel section 100, a plurality of imaging pixels 10 and AF pixels 13 (13a, 13b) are arranged. In FIG. 2, the pixel in the upper left corner is the imaging pixel 10 (1,1) in the first row and first column, and the AF pixel in the lower right corner is the AF pixel 13b (16,8) in the 16th row and eighth column, and 128 pixels from the imaging pixel 10 (1,1) to the AF pixel 13b (16,8) are illustrated. Note that the 128 pixels of 8 pixels in the row direction × 16 pixels in the column direction shown in FIG. 2 represent a pixel group arranged in an arbitrary region of the imaging surface of the imaging element 3, and the names of the 1st column to the 8th column and the 1st row to the 16th row in FIG. 2 are also given to the 128 pixels. Therefore, in the imaging element 3, pixels may exist not only to the right of the pixel in the 8th column and below the pixel in the 16th row in FIG. 2, but also to the left of the pixel in the 1st column and above the pixel in the 1st row.

[0016] The imaging pixel 10 is provided with one of three color filters 41 having different spectral characteristics, for example, R (red), G (green), and B (blue). The R color filter 41 transmits mainly light in the red wavelength range, the G color filter 41 transmits mainly light in the green wavelength range, and the B color filter 41 transmits mainly light in the blue wavelength range. The pixels have different spectral characteristics depending on the color filter 41 arranged. As a result, the imaging pixel 10 includes a pixel having a red (R) spectral characteristic (hereinafter referred to as an R pixel), a pixel having a green (G) spectral characteristic (hereinafter referred to as a G pixel), and a pixel having a blue (B) spectral characteristic (hereinafter referred to as a B pixel). The R pixel, the G pixel, and the B pixel are arranged according to a Bayer array.

[0017] The first and second AF pixels 13a and 13b are arranged by replacing a part of the R, G, and B imaging pixels 10 arranged in the Bayer array as described above. The first and second AF pixels 13a and 13b are provided with a color filter 41 and a light-shielding film 43. For example, a G color filter is arranged as the color filter 41 in the first and second AF pixels 13a and 13b. The first AF pixel 13a and the second AF pixel 13b have different positions of the light-shielding portion 43. As a result, the photoelectric conversion unit of the first AF pixel 13a receives a light flux that has passed through a first region of the first and second regions of the exit pupil of the imaging optical system 2. The photoelectric conversion unit of the second AF pixel 13b receives a light flux that has passed through a second region of the first and second regions of the exit pupil of the imaging optical system 2.

[0018] 2, the image sensor 3 has a first imaging pixel row 401 in which R pixels 10r and G pixels 10g are alternately arranged in the left-right direction, i.e., the row direction, and a second imaging pixel row 402 in which G pixels 10g and B pixels 10b are alternately arranged in the row direction. The image sensor 3 also has a first AF pixel row 403a in which G pixels 10g and first AF pixels 13a are alternately arranged in the row direction, and a second AF pixel row 403b in which G pixels 10g and second AF pixels 13b are alternately arranged in the row direction.

[0019] The vertical control unit 30 is controlled by the control unit 4 of the camera 1, and supplies a control signal to each pixel to control the operation of each pixel. The first readout unit 40a and the second readout unit 40b each include an analog / digital conversion unit (AD conversion unit). A pixel signal of the pixel unit 100 selected by the vertical control unit 30 is output to the first vertical signal line VoutA or the second vertical signal line VoutB connected to that pixel. The pixel signal output to the first vertical signal line VoutA is converted to a digital signal by the first readout unit 40a and then output to the control unit 4. The pixel signal output to the second vertical signal line VoutB is converted to a digital signal by the second readout unit 40b and then output to the control unit 4.

[0020] Fig. 3 is a diagram showing the configuration of a pixel of the imaging element 3 according to the first embodiment. Each pixel (pixels 10a and 10b in Fig. 3) includes a photoelectric conversion unit 11 and a transfer unit 12. Pixel 10a has a photoelectric conversion unit 11a and a transfer unit 12a, and pixel 10b has a photoelectric conversion unit 11b and a transfer unit 12b. Photoelectric conversion unit 11 is a photodiode PD that converts incident light into electric charges and accumulates the photoelectrically converted electric charges.

[0021] In addition, the imaging element 3 of this embodiment is configured such that two adjacent pixels share a floating diffusion (FD) 15, a reset section 16, an amplifier section 17, a first selection section 18, and a second selection section 19, as indicated by dashed line 20.

[0022] The transfer unit 12a of the pixel 10a is composed of a transistor M1 controlled by a signal TX1, and transfers the charge photoelectrically converted by the photoelectric conversion unit 11a to the FD15. That is, the transfer unit 12a forms a charge transfer path between the photoelectric conversion unit 11a and the FD15. The transfer unit 12b of the pixel 10b is composed of a transistor M2 controlled by a signal TX2, and transfers the charge photoelectrically converted by the photoelectric conversion unit 11b to the FD15. That is, the transfer unit 12b forms a charge transfer path between the photoelectric conversion unit 11b and the FD15. The transistors M1 and M2 are each a transfer transistor. The capacitance C of the FD15 accumulates (holds) the charge transferred to the FD15 and converts it into a voltage divided by the capacitance value.

[0023] The amplifier 17 amplifies and outputs a signal due to the charge accumulated in the capacitance C of the FD 15. The amplifier 17 is composed of a transistor M5 whose drain (terminal) and gate (terminal) are connected to a power supply VDD and the FD 15, respectively. The source (terminal) of the transistor M5 is connected to a first vertical signal line VoutA via a first selection unit 18, and is connected to a second vertical signal line VoutB via a second selection unit 19. The amplifier 17 functions as a part of a source follower circuit, using a current source (current sources 25a and 25b in FIG. 4) described later as a load current source. The transistor M5 is an amplifying transistor.

[0024] The reset unit 16 is composed of a transistor M4 controlled by a signal RST, and resets the charge of the FD 15 and resets the voltage of the FD 15. The transistor M4 is a reset transistor.

[0025] The first selection unit 18 is composed of a transistor M6 controlled by a signal SELA, and electrically connects or disconnects the amplifier unit 17 and the first vertical signal line VoutA. When the transistor M6 of the first selection unit 18 is in an on state, it outputs a signal from the amplifier unit 17 to the first vertical signal line VoutA. The second selection unit 19 is composed of a transistor M7 controlled by a signal SELB, and electrically connects or disconnects the amplifier unit 17 and the second vertical signal line VoutB. When the transistor M7 of the second selection unit 19 is in an on state, it outputs a signal from the amplifier unit 17 to the second vertical signal line VoutB. The transistor M6 is a first selection transistor, and the transistor M7 is a second selection transistor.

[0026] As described above, the charge photoelectrically converted by the photoelectric conversion unit 11 is transferred to the FD 15 by the transfer unit 12. Then, a signal (pixel signal) corresponding to the charge transferred to the FD 15 is output to the first vertical signal line VoutA or the second vertical signal line VoutB. The pixel signal is an analog signal generated based on the charge photoelectrically converted by the photoelectric conversion unit 11. The pixel signal output from the imaging pixel 10 is subjected to signal processing by the readout unit 40 and then output to the control unit 4 as an imaging signal.

[0027] In the present embodiment, the circuit configurations of the first AF pixel 13a and the second AF pixel 13b are the same as the circuit configuration of the imaging pixel 10. The pixel signals output from the first AF pixel 13a and the second AF pixel 13b are subjected to signal processing by a readout section 40 and then output to the control section 4 as a pair of focus detection signals.

[0028] Fig. 4 is a diagram showing a partial configuration of an image sensor 3 according to a first embodiment. Fig. 4 shows a part of one pixel column of a plurality of pixels arranged in a column direction (vertical direction) which is a first direction, and a row direction (horizontal direction) which is a second direction intersecting the first direction. The configuration of the other pixel columns is the same as that of the pixel column in Fig. 4. The image sensor 3 includes a vertical control unit 30 and a plurality of readout units 40 (first readout unit 40a, second readout unit 40b). The vertical control unit 30 is provided in common to the plurality of pixel columns.

[0029] In addition, in the image sensor 3, a first vertical signal line VoutA and a second vertical signal line VoutB are provided for a pixel column, which is a column of a plurality of pixels aligned in the column direction. A first current source 25a and a first readout unit 40a are provided for the first vertical signal line VoutA, and a second current source 25b and a second readout unit 40b are provided for the second vertical signal line VoutB. In the example shown in FIG. 4, for the sake of simplicity, only one pixel in the row direction by six pixels in the column direction are shown. Figure 4 illustrates, of the multiple pixels shown in Figure 2, G pixel 10g(1,2) in the first row, second column, B pixel 10b(2,2) in the second row, second column, G pixel 10g(3,2) in the third row, second column, B pixel 10b(4,2) in the fourth row, second column, G pixel 10g(5,2) in the fifth row, second column, and B pixel 10b(6,2) in the sixth row, second column.

[0030] The first current source 25a is connected to each pixel via a first vertical signal line VoutA, and the second current source 25b is connected to each pixel via a second vertical signal line VoutB. The first current source 25a and the second current source 25b generate a current for reading out a signal from each pixel. The first current source 25a supplies the generated current to the first vertical signal line VoutA and the first selection unit 18 and the amplifier unit 17 of each pixel. Similarly, the second current source 25b supplies the generated current to the second vertical signal line VoutB and the second selection unit 19 and the amplifier unit 17 of each pixel.

[0031] The first readout unit 40a includes an AD converter and converts analog signals input from each pixel via the first vertical signal line VoutA into digital signals. The second readout unit 40b includes an AD converter and converts analog signals input from each pixel via the second vertical signal line VoutB into digital signals.

[0032] The vertical control unit 30 supplies signals TX1, TX2, RST, SELA, and SELB to each pixel to control the operation of each pixel. Specifically, the vertical control unit 30 supplies signals to the gates of each transistor of the pixel to turn the transistor on (connected, conductive, shorted) or off (disconnected, non-conductive, open, blocked).

[0033] When the control unit 4 instructs the vertical control unit 30 to read out signals from each pixel in the imaging pixel rows (the first imaging pixel row 401 and the second imaging pixel row 402 in FIG. 2), the vertical control unit 30 performs a process of selecting the imaging pixel rows in units of two rows and reading out pixel signals (first read control). When the control unit 4 instructs the vertical control unit 30 to read out signals from each pixel in the AF pixel rows (the first AF pixel row 403a and the second AF pixel row 403b in FIG. 2), the vertical control unit 30 performs a process of selecting two AF pixel rows at a time and reading out pixel signals (second read control). Furthermore, when reading out signals from AF pixel rows, the vertical control unit 30 can also perform processing (third readout control) of selecting the AF pixel rows one by one and reading out pixel signals.

[0034] In this way, the vertical control unit 30 according to this embodiment performs the first readout control, the second readout control, and the third readout control. The control unit 4 of the camera 1 can control the vertical control unit 30 to switch the method of reading out pixel signals. The first readout control, the second readout control, and the third readout control will be described below.

[0035] First, the first read control will be described with reference to Fig. 4. In the first read control, the vertical control unit 30 selects every two imaging pixel rows of the image sensor 3 and sequentially reads out signals from the pixels. The first read control will be described below using as an example a case where pixel signals are read out from the B pixel 10b(2,2), G pixel 10g(3,2), B pixel 10b(4,2), and G pixel 10g(5,2).

[0036] The vertical control unit 30 turns on the second selection unit 19 of the B pixel 10b(2,2) which is a pixel in the second row, that is, the second selection unit 19 shared by the G pixel 10g(1,2) in the first row and the B pixel 10b(2,2) in the second row. The vertical control unit 30 also turns off the first selection unit 18 of the B pixel 10b(2,2), that is, the first selection unit 18 shared by the G pixel 10g(1,2) and the B pixel 10b(2,2). The vertical control unit 30 also turns on the first selection unit 18 of the G pixel 10g(3,2) which is a pixel in the third row, that is, the first selection unit 18 shared by the G pixel 10g(3,2) in the third row and the B pixel 10b(4,2) in the fourth row. Furthermore, the vertical control unit 30 turns off the second selection unit 19 of the G pixel 10g(3,2), i.e., the second selection unit 19 shared by the G pixel 10g(3,2) and the B pixel 10b(4,2). The vertical control unit 30 turns off the first selection unit 18 and the second selection unit 19 of the pixels in rows other than the first, second, third, and fourth rows.

[0037] A pixel signal based on the charge generated in the photoelectric conversion unit 11b of the B pixel 10b(2,2) in the second row is output to the second vertical signal line VoutB via the second selection unit 19 of the B pixel 10b(2,2). Also, a pixel signal based on the charge generated in the photoelectric conversion unit 11a of the G pixel 10g(3,2) in the third row is output to the first vertical signal line VoutA via the first selection unit 18 of the G pixel 10g(3,2).

[0038] After reading out the pixel signals from the pixels in the second and third rows, the vertical control unit 30 turns on the second selection unit 19 of the B pixel 10b(4,2), which is a pixel in the fourth row, and turns off the first selection unit 18 of the B pixel 10b(4,2). The vertical control unit 30 also turns on the first selection unit 18 of the G pixel 10g(5,2), which is a pixel in the fifth row, and turns off the second selection unit 19 of the G pixel 10g(5,2). The vertical control unit 30 turns off the first selection unit 18 and the second selection unit 19 of the pixels in rows other than the third, fourth, fifth, and sixth rows.

[0039] The pixel signal of the B pixel 10b(4,2) in the fourth row is output to the second vertical signal line VoutB via the second selection unit 19 of the B pixel 10b(4,2). In addition, the pixel signal of the G pixel 10g(5,2) in the fifth row is output to the first vertical signal line VoutA via the first selection unit 18 of the G pixel 10g(5,2). Similarly, in the image sensor 3, imaging pixel rows are selected two at a time from the sixth row onwards, and pixel signals are output.

[0040] In this way, in the case of the first readout control, the imaging pixel rows are selected two at a time in the imaging element 3, and pixel signals are output from the imaging pixels in one row to the first vertical signal line VoutA. At the same time, pixel signals are output from the imaging pixels in the other row to the second vertical signal line VoutB. The pixel signals sequentially output to the first vertical signal line VoutA are input to the first readout section 40a, and the pixel signals sequentially output to the second vertical signal line VoutB are input to the second readout section 40b. Therefore, the pixel signals output to the first vertical signal line VoutA and the pixel signals output to the second vertical signal line VoutB can be simultaneously (parallel) processed. The pixel signals output from each imaging pixel 10 are converted to digital signals by the readout section 40, and then output to the control section 4 as imaging signals.

[0041] In this embodiment, pixel signals from multiple G pixels 10g (G pixel 10g(1,2), G pixel 10g(3,2), and G pixel 10g(5,2) in FIG. 4) in the same column are output to the same first vertical signal line VoutA and input to the same first readout unit 40a. The AD conversion unit of the first readout unit 40a converts the input pixel signals of each G pixel 10g into digital signals. The pixel signals of each G pixel 10g are processed by the same AD conversion unit. Furthermore, pixel signals from multiple B pixels 10b (B pixel 10b(2,2), B pixel 10b(4,2), and B pixel 10b(6,2) in FIG. 4) in the same column are output to the same second vertical signal line VoutB and input to the same second readout unit 40b for processing. In this manner, in this embodiment, pixel signals from imaging pixels 10 in the same column in which color filters 41 of the same color are arranged are input to the same readout section 40 and processed.

[0042] In readout sections provided at positions apart from each other, there is a risk that the characteristics of each readout section will vary due to manufacturing variations, etc. For example, the conversion gain (AD conversion gain) when converting an analog pixel signal into a digital signal will differ for each readout section. For this reason, when pixel signals of the same color pixels in the same column are input to different readout sections, differences will occur in the pixel signals converted into digital signals due to differences in AD conversion gain.

[0043] In contrast, in the image sensor 3 according to the present embodiment, pixel signals of pixels of the same color in the same column are input to the same readout section 40, so that it is possible to suppress differences in pixel signals due to variations in characteristics between the readout sections 40. For example, it is possible to suppress differences in pixel signals of each image pixel 10 due to deviations in AD conversion gain. As a result, it is possible to prevent deterioration in the quality of an image generated using the image signals.

[0044] Fig. 5 is a timing chart showing an example of the first readout control of the image sensor 3 according to the first embodiment. In the timing chart shown in Fig. 5, the horizontal axis indicates time, and shows control signals input to each unit of the image sensor 3 in Fig. 4 in the case of the first readout control. In Fig. 5, a transistor to which a high-level (e.g., power supply potential) control signal is input is turned on, and a transistor to which a low-level (e.g., ground potential) control signal is input is turned off.

[0045] At time t1 shown in FIG. 5, the signal RST <0> and signal RST <1> The signal RST becomes high level. <0> When this signal goes high, the transistor M4 of the reset unit 16 shared by the G pixel 10g(1,2) in the first row and the B pixel 10b(2,2) in the second row is turned on. This resets the charge on the capacitance C of the FD 15 shared by the G pixel 10g(1,2) and the B pixel 10b(2,2), and the potential of the FD 15 becomes the reset potential. Also, the signal RST <1> becomes high level, turning on the transistor M4 of the reset unit 16 shared by the G pixel 10g(3,2) in the third row and the B pixel 10b(4,2) in the fourth row. This resets the charge on the capacitance C of the FD 15 shared by the G pixel 10g(3,2) and the B pixel 10b(4,2), and the potential of the FD 15 becomes the reset potential.

[0046] Also, at time t1, the signal SELB <0> and signal SELA <1> The signal SELB goes high. <0> When the second selection unit 19 and the amplifier unit 17 of the B pixel 10b(2,2) become high level, a signal based on the reset potential of the B pixel 10b(2,2) is output to the second vertical signal line VoutB by the amplifier unit 17 and the second selection unit 19 of the B pixel 10b(2,2). That is, a signal (reset signal) obtained after the charge of the FD 15 of the B pixel 10b(2,2) is reset is output to the second vertical signal line VoutB. Also, the signal SELA <1> When this signal goes high, the reset signal of the G pixel 10g(3,2) is output to the first vertical signal line VoutA by the amplifier 17 and first selector 18 of the G pixel 10g(3,2).

[0047] In this manner, reset signals are simultaneously output from the G pixel 10g(3,2) in the third row and the B pixel 10b(2,2) in the second row to the first vertical signal line VoutA and the second vertical signal line VoutB, respectively. The reset signals output to the first vertical signal line VoutA and the second vertical signal line VoutB, respectively, are input to the first readout unit 40a and the second readout unit 40b and converted into digital signals.

[0048] At time t2, signal TX2 <0> and signal TX1 <1> becomes high level. Signal TX2 <0> When the signal TX1 goes high, the transistor M2 of the transfer unit 12b in the B pixel 10b(2,2) is turned on, and the charge photoelectrically converted by the photoelectric conversion unit 11b is transferred to the FD 15. <1> When the signal goes high, the transistor M1 of the transfer unit 12a in the G pixel 10g(3,2) is turned on, and the charge photoelectrically converted by the photoelectric conversion unit 11a is transferred to the FD15.

[0049] At time t2, the signal SELB <0> Since the signal SELA is at a high level, a pixel signal based on the charge generated by the photoelectric conversion unit 11b of the B pixel 10b(2,2) is output to the second vertical signal line VoutB by the amplifier 17 and the second selection unit 19. <1> is at a high level, the pixel signal of the G pixel 10g(3,2) is output to the first vertical signal line VoutA by the amplifier 17 and the first selection unit 18.

[0050] In this manner, pixel signals are simultaneously output from the G pixel 10g(3,2) in the third row and the B pixel 10b(2,2) in the second row to the first vertical signal line VoutA and the second vertical signal line VoutB, respectively. The pixel signals output to the first vertical signal line VoutA and the second vertical signal line VoutB are input to the first readout unit 40a and the second readout unit 40b, respectively, and converted to digital signals. The reset signal and the pixel signal converted to digital signals are input to a signal processing unit (not shown). The signal processing unit performs signal processing such as correlated double sampling for performing differential processing between the reset signal and the pixel signal, and then outputs the processed pixel signal to the control unit 4.

[0051] At time t3, the signal RST <1> and signal RST <2> The signal RST becomes high level. <1> When this signal goes high, the transistor M4 of the reset unit 16 shared by the G pixel 10g(3,2) in the third row and the B pixel 10b(4,2) in the fourth row is turned on. This resets the charge on the capacitance C of the FD 15 shared by the G pixel 10g(3,2) and the B pixel 10b(4,2). Also, the signal RST <2> When the signal goes high, the transistor M4 of the reset unit 16 shared by the G pixel 10g(5,2) in the fifth row and the B pixel 10b(6,2) in the sixth row is turned on. This resets the charge on the capacitance C of the FD 15 shared by the G pixel 10g(5,2) and the B pixel 10b(6,2).

[0052] Also, at time t3, the signal SELB <1> and signal SELA <2> The signal SELB goes high. <1> When the signal SELA becomes high level, the reset signal of the B pixel 10b(4,2) is output to the second vertical signal line VoutB by the amplifier 17 and the second selection unit 19. <2> When the signal goes high, the reset signal of the G pixel 10g(5,2) is output to the first vertical signal line VoutA by the amplifier 17 and the first selector 18.

[0053] In this manner, reset signals are simultaneously output from the G pixel 10g(5,2) in the fifth row and the B pixel 10b(4,2) in the fourth row to the first vertical signal line VoutA and the second vertical signal line VoutB, respectively. The reset signals output to the first vertical signal line VoutA and the second vertical signal line VoutB, respectively, are input to the first readout unit 40a and the second readout unit 40b and converted into digital signals.

[0054] At time t4, signal TX2 <1> and signal TX1 <2> becomes high level. Signal TX2 <1> When the signal TX1 goes high, the charge photoelectrically converted by the photoelectric conversion unit 11b in the B pixel 10b(4,2) is transferred to the FD 15. <2> When the signal SELB becomes high level, the charge photoelectrically converted by the photoelectric conversion unit 11a in the G pixel 10g(5,2) is transferred to the FD 15. Also, at time t4, the signal SELB <1> Since the signal SELA is at a high level, the pixel signal of the B pixel 10b(4,2) is output to the second vertical signal line VoutB by the amplifier 17 and the second selection unit 19. <2> is at a high level, the pixel signal of the G pixel 10g(5,2) is output to the first vertical signal line VoutA by the amplifier 17 and the first selection unit 18.

[0055] In this manner, pixel signals are simultaneously output from the G pixel 10g (5,2) in the fifth row and the B pixel 10b (4,2) in the fourth row to the first vertical signal line VoutA and the second vertical signal line VoutB, respectively. The pixel signals output to the first vertical signal line VoutA and the second vertical signal line VoutB are input to the first readout unit 40a and the second readout unit 40b, respectively, and converted to digital signals. The reset signal and the pixel signal converted to digital signals are input to a signal processing unit (not shown). The signal processing unit performs signal processing such as correlated double sampling, and then outputs the processed pixel signals to the control unit 4.

[0056] In the period after time t5, similarly to the period from time t1 to time t5, imaging pixel rows are selected two at a time, and reset signals and pixel signals are read out. In this way, in the first readout control shown in Fig. 5, imaging pixel rows are selected two at a time, and pixel signals can be read out simultaneously for multiple rows.

[0057] Next, the second readout control will be described with reference to Fig. 6 and Fig. 7. In the example shown in Fig. 6, for the sake of simplicity, among the multiple pixels shown in Fig. 2, the G pixel 10g (7,2) in the seventh row and second column, the first AF pixel 13a (8,2) in the eighth row and second column, the G pixel 10g (15,2) in the fifteenth row and second column, and the second AF pixel 13b (16,2) in the sixteenth row and second column are illustrated. In the second readout control, the vertical control unit 30 sequentially selects every two AF pixel rows of the image sensor 3 and sequentially reads out signals from the pixels.

[0058] The vertical control unit 30 turns on the first selection unit 18 of the first AF pixel 13a(8,2) in the 8th row, which is an AF pixel row, and turns off the second selection unit 19 of the first AF pixel 13a(8,2). The vertical control unit 30 also turns on the second selection unit 19 of the second AF pixel 13b(16,2) in the 16th row, which is an AF pixel row, and turns off the first selection unit 18 of the second AF pixel 13b(16,2). The vertical control unit 30 turns off the first selection unit 18 and the second selection unit 19 of the pixels in rows other than the 7th row, the 8th row, the 15th row, and the 16th row. As a result, the pixel signal of the first AF pixel 13a(8,2) in the 8th row is output to the first vertical signal line VoutA via the first selection unit 18 of the first AF pixel 13a(8,2). Furthermore, the pixel signal of the second AF pixel 13b(16,2) in the 16th row is output to the second vertical signal line VoutB via the second selection unit 19 of the second AF pixel 13b(16,2). Similarly, in the image sensor 3, for the AF pixel rows in the 17th row and onwards, the AF pixel rows are sequentially selected two at a time, and pixel signals are output.

[0059] In this way, in the case of the second readout control, two AF pixel rows are selected at a time in the image sensor 3, and pixel signals are output from the AF pixels in one row to the first vertical signal line VoutA. At the same time, pixel signals are output from the AF pixels in the other row to the second vertical signal line VoutB. This allows signals to be read out at high speed from each AF pixel 13 arranged in the image sensor 3. That is, the image sensor 3 can shorten the time required to read out the signals from the AF pixels 13. This allows the control unit 4 to shorten the time required for focus detection and focus adjustment.

[0060] Furthermore, the pixel signals output to the first vertical signal line VoutA and the second vertical signal line VoutB are input to the first readout unit 40a and the second readout unit 40b, respectively, and converted to digital signals. Since the pixel signals of each AF pixel 13 are processed in parallel by the first and second readout units 40a and 40b, AD conversion processing of the pixel signals of each AF pixel can be performed at high speed. The pixel signal of the first AF pixel 13a and the pixel signal of the second AF pixel 13b are each converted to a digital signal by the readout unit 40, and then output to the control unit 4 as a pair of focus detection signals.

[0061] Fig. 7 is a timing chart showing an example of the second readout control of the image sensor 3 according to the first embodiment. In the timing chart shown in Fig. 7, the horizontal axis indicates time, and shows control signals input to each unit of the image sensor 3 in Fig. 6 in the case of the second readout control.

[0062] At time t1 shown in FIG. <3> and signal RST <4> The signal RST becomes high level. <3> When the signal RST goes high, the charge of the capacitance C of the FD 15 is reset in the G pixel 10g (7,2) in the seventh row and the first AF pixel 13a (8,2) in the eighth row. <4> When the signal goes high, the charge on the capacitance C of the FD 15 is reset in the G pixel 10g (15,2) in the 15th row and the second AF pixel 13b (16,2) in the 16th row.

[0063] Also, at time t1, the signal SELA <3> and signal SELB <4> The signal SELA becomes high level. <3> When the signal SELB becomes high level, the reset signal of the first AF pixel 13a(8,2) is output to the first vertical signal line VoutA by the amplifier 17 and the first selection unit 18. <4> When the second AF pixel 13b(16,2) goes to high level, the reset signal of the second AF pixel 13b(16,2) is output to the second vertical signal line VoutB by the amplifier 17 and the second selector 19.

[0064] In this manner, reset signals are simultaneously output from the first AF pixel 13a (8,2) in the 8th row and the second AF pixel 13b (16,2) in the 16th row to the first vertical signal line VoutA and the second vertical signal line VoutB, respectively. The reset signals output to the first vertical signal line VoutA and the second vertical signal line VoutB, respectively, are input to the first readout unit 40a and the second readout unit 40b and converted into digital signals.

[0065] At time t2, signal TX2 <3> and signal TX2 <4> becomes high level. Signal TX2 <3> When the signal TX2 goes high, the charge photoelectrically converted by the photoelectric conversion unit 11b in the first AF pixel 13a(8,2) in the eighth row is transferred to the FD 15. <4> When the signal goes high, the charge photoelectrically converted by the photoelectric conversion unit 11b in the second AF pixel 13b (16,2) in the 16th row is transferred to the FD 15. Also, at time t2, the signal SELA <3> Since the signal SELB is at a high level, the pixel signal of the first AF pixel 13a(8,2) is output to the first vertical signal line VoutA by the amplifier 17 and the first selection unit 18. <4> is at a high level, the pixel signal of the second AF pixel 13b (16,2) is output to the second vertical signal line VoutB by the amplifier 17 and the second selector 19.

[0066] In this manner, pixel signals are simultaneously output from the first AF pixel 13a (8,2) in the 8th row and the second AF pixel 13b (16,2) in the 16th row to the first vertical signal line VoutA and the second vertical signal line VoutB, respectively. The pixel signals output to the first vertical signal line VoutA and the second vertical signal line VoutB are input to the first readout unit 40a and the second readout unit 40b, respectively, and converted to digital signals. The reset signal and the pixel signal converted to digital signals are input to a signal processing unit (not shown). The signal processing unit performs signal processing such as correlated double sampling for performing differential processing between the reset signal and the pixel signal, and then outputs the processed pixel signal to the control unit 4.

[0067] Next, the third readout control will be described with reference to Fig. 6 and Fig. 8. In the third readout control, the vertical control unit 30 sequentially selects the AF pixel rows of the image sensor 3 one by one, and sequentially reads out signals from the pixels.

[0068] The vertical control unit 30 turns on the first selection unit 18 of the first AF pixel 13a(8,2) in the eighth row, which is an AF pixel row, and turns off the second selection unit 19 of the first AF pixel 13a(8,2). The vertical control unit 30 also turns off the first selection unit 18 and the second selection unit 19 of the pixels in rows other than the seventh and eighth rows. As a result, the pixel signal of the first AF pixel 13a(8,2) in the eighth row is output to the first vertical signal line VoutA via the first selection unit 18.

[0069] After reading out the pixel signal from the pixel in the 8th row, the first selection unit 18 of the second AF pixel 13b (16,2) in the 16th row, which is an AF pixel row, is turned on, and the second selection unit 19 of the second AF pixel 13b (16,2) is turned off. In addition, the vertical control unit 30 turns off the first selection unit 18 and the second selection unit 19 of the pixels in rows other than the 15th and 16th rows. As a result, the pixel signal of the second AF pixel 13b (16,2) in the 16th row is output to the first vertical signal line VoutA via the first selection unit 18.

[0070] Although an example has been described in which the pixel signal of the AF pixel 13 is output to the first vertical signal line VoutA, when the first selection unit 18 is in the off state and the second selection unit 19 is in the on state, the pixel signal can be output from the AF pixel 13 to the second vertical signal line VoutB.

[0071] Thus, in the case of the third readout control, in the image sensor 3, AF pixel rows are selected one by one, and pixel signals are output from each pixel in the AF pixel row to the first vertical signal line VoutA (or the second vertical signal line VoutB). The pixel signals of each AF pixel in the same column are input to the AD conversion unit of the same readout unit 40. This makes it possible to suppress differences in the pixel signals output from each AF pixel due to deviations in AD conversion gain. As a result, it is possible to prevent a decrease in the accuracy of focus detection using focus detection signals.

[0072] Fig. 8 is a timing chart showing an example of the third readout control of the image sensor 3 according to the first embodiment. In the timing chart shown in Fig. 8, the horizontal axis indicates time, and shows control signals input to each unit of the image sensor 3 in Fig. 6 in the case of the third readout control.

[0073] At time t1 shown in FIG. <3> When the signal SELA becomes high level, the charge of the capacitance C of the FD 15 is reset in the G pixel 10g (7,2) in the seventh row and the first AF pixel 13a (8,2) in the eighth row. <3> When the signal VoutA becomes high level, the reset signal of the first AF pixel 13a(8,2) is output to the first vertical signal line VoutA.

[0074] At time t2, signal TX2 <3> As a result of the signal SELA going to a high level, in the first AF pixel 13a(8,2) in the eighth row, the charge photoelectrically converted by the photoelectric conversion unit 11b is transferred to the FD 15. <3> is at a high level, the pixel signal of the first AF pixel 13a(8,2) is output to the first vertical signal line VoutA.

[0075] At time t3, the signal RST <4> As a result of the signal SELA going to high level, the charge of the capacitance C of the FD 15 is reset in the G pixel 10g (15,2) in the 15th row and the second AF pixel 13b (16,2) in the 16th row. <4> When the signal VoutA becomes high level, the reset signal of the second AF pixel 13b(16,2) is output to the first vertical signal line VoutA.

[0076] At time t4, signal TX2 <4> As a result of the signal SELA going to a high level, in the second AF pixel 13b (16,2) in the 16th row, the charge photoelectrically converted by the photoelectric conversion unit 11b is transferred to the FD 15. <4> is at a high level, the pixel signal of the second AF pixel 13b(16,2) is output to the first vertical signal line VoutA.

[0077] The reset signal and the pixel signal sequentially output to the first vertical signal line VoutA are converted into a digital signal by the first readout unit 40a. The pixel signal converted into a digital signal is output to the control unit 4 after signal processing such as correlated double sampling is performed.

[0078] In this way, the image sensor 3 according to this embodiment can perform the first readout control, the second readout control, and the third readout control. By performing the first readout control, the image sensor 3 can improve the accuracy of the signals of the imaging pixels. Furthermore, in the case of the second readout control, the image sensor 3 can improve the readout speed of the signals of the AF pixels, and in the case of the third readout control, the image sensor 3 can improve the accuracy of the signals of the AF pixels.

[0079] According to the above-described embodiment, the following advantageous effects can be obtained. (1) The image sensor 3 includes a first pixel (AF pixel 13) and a second pixel (AF pixel 13) arranged in a first direction, each of which has a first photoelectric conversion unit (photoelectric conversion unit 11) that performs photoelectric conversion on light to generate electric charges and a light-shielding unit 43 that blocks a portion of light incident on the first photoelectric conversion unit and outputs a signal based on the electric charges generated in the first photoelectric conversion unit, and a third pixel (imaging pixel 10) and a fourth pixel (imaging pixel 10) arranged in the first direction, each of which has a second photoelectric conversion unit that performs photoelectric conversion on light to generate electric charges and outputs a signal based on the electric charges generated in the second photoelectric conversion unit. The image pickup device includes a pixel (imaging pixel 10), a first signal line (first vertical signal line VoutA) and a second signal line (second vertical signal line VoutB) that are provided in a first direction and output a signal from any one of a first pixel, a second pixel, a third pixel, and a fourth pixel, and a control unit (vertical control unit 30) that performs a first control (second readout control) for outputting a signal from the first pixel to the first signal line and a signal from the second pixel to the second signal line, and a second control (first readout control) for outputting a signal from the third pixel and a signal from the fourth pixel to the first signal line or the second signal line. In this embodiment, the vertical control unit 30 performs the first control (second readout control) and the second control (first readout control). The vertical control unit 30 can improve the accuracy of the signal from the imaging pixel by performing the second control, and can improve the readout speed of the signal from the AF pixel by performing the first control.

[0080] (2) The control unit (vertical control unit 30) performs a third control (third readout control) for outputting the signal of the first pixel and the signal of the second pixel to the first signal line or the second signal line. In the present embodiment, the vertical control unit 30 performs the third control (third readout control). By performing the third control, the vertical control unit 30 can improve the accuracy of the signal of the AF pixel.

[0081] The following modifications are also within the scope of the present invention, and one or more of the modifications may be combined with the above-described embodiment.

[0082] (Variation 1) FIG. 9 is a diagram showing a configuration of a part of an image sensor according to the first modification, and FIG. 10 is a timing chart showing an example of a first read control of the image sensor according to the first modification. In the example shown in FIG. 9, only one pixel in the row direction and four pixels in the column direction are shown for the sake of simplicity. FIG. 9 shows, among the multiple pixels shown in FIG. 2, a G pixel 10g(1,2) in the first row and second column, a B pixel 10b(2,2) in the second row and second column, a G pixel 10g(3,2) in the third row and second column, and a B pixel 10b(4,2) in the fourth row and second column. Hereinafter, the first read control of the image sensor according to the first modification will be described with reference to FIG. 9 and FIG. 10.

[0083] At time t1 shown in FIG. <0> and signal RST <1> The signal RST becomes high level. <0> When the signal goes high, the charge on the capacitance C of the FD 15 shared by the G pixel 10g(1,2) and the B pixel 10b(2,2) is reset. Also, the signal RST <1> When the signal goes high, the charge on the capacitance C of the FD 15 shared by the G pixel 10g(3,2) and the B pixel 10b(4,2) is reset.

[0084] Also, at time t1, the signal SELA <0> and signal SELB <1> The signal SELA becomes high level. <0> When this signal goes high, the reset signal of the G pixel 10g(1,2) is output to the first vertical signal line VoutA by the amplifier 17 and first selector 18 of the G pixel 10g(1,2). Also, the signal SELB <1> When the reset signal of the B pixel 10b(4,2) becomes high level, the reset signal of the B pixel 10b(4,2) is output to the second vertical signal line VoutB by the amplifier unit 17 and the second selection unit 19 of the B pixel 10b(4,2).

[0085] In this manner, reset signals are simultaneously output from the G pixel 10g(1,2) in the first row and the B pixel 10b(4,2) in the fourth row to the first vertical signal line VoutA and the second vertical signal line VoutB, respectively. The reset signals output to the first vertical signal line VoutA and the second vertical signal line VoutB, respectively, are input to the first readout unit 40a and the second readout unit 40b and converted into digital signals.

[0086] At time t2, the signal TX1 <0> and signal TX2 <1> becomes high level. Signal TX1 <0> When the signal TX2 goes high, the charge photoelectrically converted by the photoelectric conversion unit 11a in the G pixel 10g(1,2) is transferred to the FD 15. <1> When the signal goes high, the charge photoelectrically converted by the photoelectric conversion unit 11b in the B pixel 10b(4,2) is transferred to the FD 15. Also, at time t2, the signal SELA <0> Since the signal SELB is at a high level, the pixel signal of the G pixel 10g(1,2) is output to the first vertical signal line VoutA. <1> is at a high level, the pixel signal of the B pixel 10b(4,2) is output to the second vertical signal line VoutB.

[0087] In this manner, pixel signals are simultaneously output to the first vertical signal line VoutA and the second vertical signal line VoutB from the G pixel 10g(1,2) in the first row and the B pixel 10b(4,2) in the fourth row, respectively. The pixel signals output to the first vertical signal line VoutA and the second vertical signal line VoutB are input to the first readout unit 40a and the second readout unit 40b, respectively, and converted to digital signals. The pixel signals converted to digital signals are subjected to signal processing such as correlated double sampling, and then output to the control unit 4.

[0088] At time t3, the signal RST <0> and signal RST <1> The signal RST becomes high level. <0> When the signal goes high, the charge on the capacitance C of the FD 15 shared by the G pixel 10g(1,2) and the B pixel 10b(2,2) is reset. Also, the signal RST <1> When the signal goes high, the charge on the capacitance C of the FD 15 shared by the G pixel 10g(3,2) and the B pixel 10b(4,2) is reset.

[0089] Also, at time t3, the signal SELB <0> and signal SELA <1> The signal SELB goes high. <0> When the signal SELA becomes high level, the reset signal of the B pixel 10b(2,2) is output to the second vertical signal line VoutB. <1> When the signal goes high, the reset signal of the G pixel 10g(3,2) is output to the first vertical signal line VoutA.

[0090] In this manner, reset signals are simultaneously output from the G pixel 10g(3,2) in the third row and the B pixel 10b(2,2) in the second row to the first vertical signal line VoutA and the second vertical signal line VoutB, respectively. The reset signals output to the first vertical signal line VoutA and the second vertical signal line VoutB are input to the first readout unit 40a and the second readout unit 40b, respectively, and converted into digital signals.

[0091] At time t4, signal TX2 <0> and signal TX1 <1> becomes high level. Signal TX2 <0> When the signal TX1 goes high, the charge photoelectrically converted by the photoelectric conversion unit 11b in the B pixel 10b(2,2) is transferred to the FD 15. <1> When the signal SELB becomes high level, the charge photoelectrically converted by the photoelectric conversion unit 11a in the G pixel 10g(3,2) is transferred to the FD 15. Also, at time t4, the signal SELB <0> Since the signal SELA is at a high level, the pixel signal of the B pixel 10b(2,2) is output to the second vertical signal line VoutB. <1> is at a high level, the pixel signal of the G pixel 10g(3,2) is output to the first vertical signal line VoutA.

[0092] In this manner, pixel signals are simultaneously output to the first vertical signal line VoutA and the second vertical signal line VoutB from the G pixel 10g(3,2) in the third row and the B pixel 10b(2,2) in the second row, respectively. The pixel signals output to the first vertical signal line VoutA and the second vertical signal line VoutB are input to the first readout unit 40a and the second readout unit 40b, respectively, and converted to digital signals. The pixel signals converted to digital signals are subjected to signal processing such as correlated double sampling, and then output to the control unit 4.

[0093] In the period after time t5, similarly to the period from time t1 to time t5, imaging pixel rows are selected two at a time, and reset signal readout and pixel signal readout are performed. In this manner, in the first readout control according to the first modification, similarly to the above-described embodiment, imaging pixel rows are selected two at a time, and pixel signals can be simultaneously read out in units of multiple rows. Furthermore, pixel signals of pixels of the same color in the same column can be read out to the same readout section 40, and differences in pixel signals due to variations in characteristics of each readout section 40 can be suppressed.

[0094] (Variation 2) In the above-mentioned first embodiment, an example has been described in which two adjacent pixels share the FD 15, etc., but the pixel configuration is not limited to this. For example, each of the pixels provided in the image sensor 3 may have the FD 15, a reset unit 16, an amplifier unit 17, a first selection unit 18, and a second selection unit 19. Also, a configuration in which the FD 15, etc. is shared by three or more pixels may be used. For example, a configuration in which the FD 15, etc. is shared by four pixels may be used.

[0095] Fig. 11 is a diagram showing an example of the configuration of an image sensor in which four pixels share an FD 15 etc. In Fig. 11, the pixel in the upper left corner is the imaging pixel 10(1,1) in the first row and first column, and the pixel in the lower right corner is the imaging pixel 10(8,3) in the eighth row and third column, and 24 pixels from imaging pixel 10(1,1) to imaging pixel 10(8,3) are shown.

[0096] 11, dotted lines 20 indicate that four pixels share the FD 15, the reset unit 16, the amplifier unit 17, the first selection unit 18, and the second selection unit 19. The AF pixel 13 shown in Fig. 11 is the first AF pixel 13a or the second AF pixel 13b described above. AF pixel 13(2,2) shares the FD 15, etc. with AF pixel 13(4,2), and AF pixel 13(6,2) shares the FD 15, etc. with AF pixel 13(8,2).

[0097] In the third readout control, the vertical control unit 30 according to this modification sequentially selects, for example, the AF pixel 13(2,2), the AF pixel 13(4,2), the AF pixel 13(6,2), and the AF pixel 13(8,2) to read out signals. In the second readout control, the vertical control unit 30 selects the AF pixel 13(2,2) or the AF pixel 13(4,2) to output a pixel signal to the first vertical signal line VoutA (or the second vertical signal line VoutB). At the same time as this readout, the vertical control unit 30 selects the AF pixel 13(6,2) or the AF pixel 13(8,2) to output a pixel signal to the second vertical signal line VoutB (or the first vertical signal line VoutA). For this reason, even when the FD 15 or the like is shared between a plurality of AF pixels, signals can be read out at high speed from each AF pixel 13.

[0098] (Variation 3) In the above-described embodiment, the vertical signal lines are described as being arranged as the first vertical signal line VoutA and the second vertical signal line VoutB, but the present invention is not limited to this. For example, three or more vertical signal lines may be arranged. If the number of vertical signal lines is increased, the pixel signals of the AF pixels 13 can be read out at a higher speed.

[0099] (Variation 4) In the above embodiment, an example has been described in which the G color filter 41 is disposed in the AF pixel 13, but the present invention is not limited to this. For example, the AF pixel 13 may be provided with a W (white) color filter or a B color filter as the color filter 41.

[0100] (Modification 5) In the above embodiment, a primary color (RGB) color filter is used in the imaging element 3, but a complementary color (CMY) color filter may be used.

[0101] (Variation 6) In the above-described embodiment and modified example, a photodiode is used as the photoelectric conversion unit. However, a photoelectric conversion film may be used as the photoelectric conversion unit.

[0102] (Variation 7) The imaging element 3 described in the above-mentioned embodiment and modified examples may be applied to cameras, smartphones, tablets, cameras built into PCs, car-mounted cameras, cameras mounted on unmanned aerial vehicles (drones, radio-controlled aircraft, etc.), and the like.

[0103] (Variation 8) The imaging elements described in the above-mentioned embodiments and modifications may be applied to a stacked sensor (stacked type imaging element) configured by stacking a plurality of substrates (for example, a plurality of semiconductor substrates). For example, the pixel section 100 is disposed on a first layer substrate, the vertical control section 30 and the readout section 40 are disposed on a second layer substrate, and the vertical signal line Vout is disposed between the first layer substrate and the second layer substrate. The pixel section 100 and the vertical control section 30 may be disposed on the first layer substrate, and the readout section 40 may be disposed on the second layer substrate. The stacked sensor may also have three or more layers.

[0104] Although various embodiments and modifications have been described above, the present invention is not limited to these. Other embodiments that are conceivable within the scope of the technical idea of ​​the present invention are also included within the scope of the present invention.

[0105] The disclosures of the following priority applications are incorporated herein by reference: Japanese Patent Application No. 2018-67700 (filed March 30, 2018) [Explanation of symbols]

[0106] 3 imaging element, 4 control unit, 10 imaging pixel, 13a first AF pixel, 13b second AF pixel, 30 vertical control unit, 40a first readout unit, 40b second readout unit

Claims

1. a pixel section in which a first pixel has a first photoelectric conversion unit that converts light transmitted through an optical system into an electric charge, and outputs a first signal used for focus detection of the optical system, a second pixel has a second photoelectric conversion unit that converts light transmitted through the optical system into an electric charge, and outputs a second signal used for focus detection of the optical system, a third pixel has a third photoelectric conversion unit that converts light transmitted through the optical system into an electric charge, and outputs a third signal used for image generation, and a fourth pixel has a fourth photoelectric conversion unit that converts light transmitted through the optical system into an electric charge, and outputs a fourth signal used for image generation, are arranged along a column direction; a first signal line electrically connectable to the first pixel, the second pixel, the third pixel, and the fourth pixel; a second signal line electrically connectable to the first pixel, the second pixel, the third pixel, and the fourth pixel; a first readout unit that performs signal processing on the signal output to the first signal line among the first signal, the second signal, the third signal, and the fourth signal; a second readout unit that performs signal processing on the signal output to the second signal line among the first signal, the second signal, the third signal, and the fourth signal; a vertical control unit that performs a first control for controlling the first pixel and the second pixel so that the first signal and the second signal are output to one of the first signal line and the second signal line, and a second control for controlling the third pixel and the fourth pixel so that the third signal and the fourth signal are output to a different signal line of the first signal line and the second signal line; An imaging element comprising:

2. 2. The imaging device according to claim 1, The vertical control unit includes: In the first control, the first pixel and the second pixel are controlled so that the first signal and the second signal are output to one of the first signal line and the second signal line during a first period; In the second control, the third pixel and the fourth pixel are controlled so that the third signal and the fourth signal are output to different signal lines among the first signal line and the second signal line for a second period shorter than the first period.

3. 3. The imaging device according to claim 2, The vertical control unit includes: In the first control, the first pixel and the second pixel are controlled so that the first signal and the second signal are output to one of the first signal line and the second signal line at different timings; In the second control, the third pixel and the fourth pixel are controlled so that the third signal and the fourth signal are output at the same timing to different signal lines among the first signal line and the second signal line.

4. 3. The imaging device according to claim 2, The vertical control unit includes: In the first control, the first pixel and the second pixel are controlled so that the first signal and the second signal are sequentially output to one of the first signal line and the second signal line; In the second control, the third pixel and the fourth pixel are controlled so that the third signal and the fourth signal are simultaneously output to different signal lines of the first signal line and the second signal line.

5. 5. The imaging device according to claim 1, an imaging element, wherein the first readout section and the second readout section are disposed at a distance greater than a distance between the first readout section and the pixel section;

6. 6. The imaging device according to claim 5, The pixel unit is disposed between the first readout unit and the second readout unit in the column direction.

7. 7. The imaging device according to claim 1, the first readout unit has a first conversion unit that converts a signal output to the first signal line, among the first signal, the second signal, the third signal, and the fourth signal, into a digital signal; the second readout unit has a second conversion unit that converts a signal output to the second signal line, among the first signal, the second signal, the third signal, and the fourth signal, into a digital signal; Image sensor.

8. The imaging device according to claim 1 , a first selection section for electrically connecting the first pixel and the first signal line; a second selection section for electrically connecting the first pixel and the second signal line; a third selection section for electrically connecting the second pixel and the first signal line; a fourth selection unit for electrically connecting the second pixel and the second signal line; a fifth selection section for electrically connecting the third pixel and the first signal line; a sixth selection unit for electrically connecting the third pixel and the second signal line; a seventh selection unit for electrically connecting the fourth pixel and the first signal line; an eighth selection unit for electrically connecting the fourth pixel and the second signal line; Equipped with An imaging element, wherein the vertical control unit controls the first selection unit, the second selection unit, the third selection unit, the fourth selection unit, the fifth selection unit, the sixth selection unit, the seventh selection unit, and the eighth selection unit so that the first control and the second control are performed.

9. 9. The imaging device according to claim 1, The pixel unit includes: a fifth pixel including a fifth photoelectric conversion unit that converts light transmitted through the optical system into an electric charge and outputs a fifth signal used for image generation; a sixth pixel including a sixth photoelectric conversion unit that converts light transmitted through the optical system into an electric charge and outputs a sixth signal used for image generation; is placed, the first pixel, the second pixel, the third pixel, the fourth pixel, the fifth pixel, and the sixth pixel are arranged along the column direction; Image sensor.

10. 10. The imaging device according to claim 9, The fifth pixel is disposed adjacent to the first pixel, The sixth pixel is disposed adjacent to the second pixel.

11. The imaging device according to claim 10, a first floating diffusion to which the charges converted in the first photoelectric conversion unit and the charges converted in the fifth photoelectric conversion unit are transferred; a second floating diffusion to which the electric charges converted in the second photoelectric conversion unit and the electric charges converted in the sixth photoelectric conversion unit are transferred; An imaging element comprising:

12. The imaging device according to claim 11, The first photoelectric conversion unit and the fifth photoelectric conversion unit convert light transmitted through filters having different spectral characteristics into electric charges, The second photoelectric conversion unit and the sixth photoelectric conversion unit convert light transmitted through filters having different spectral characteristics into electric charges.

13. The imaging device according to any one of claims 1 to 12, The first photoelectric conversion unit and the second photoelectric conversion unit convert light transmitted through a complementary color filter into electric charges.

14. The imaging device according to any one of claims 1 to 13, the first pixel has a first light-shielding film that blocks light transmitted through the optical system, the second pixel has a second light-shielding film that blocks light that has passed through the optical system.

15. 15. The imaging device according to claim 14, the first light-shielding film is disposed so that the first photoelectric conversion unit converts light that has passed through a first region of an exit pupil of the optical system into an electric charge and does not convert light that has passed through a second region of the exit pupil of the optical system into an electric charge; an imaging element, wherein the second light-shielding film is positioned such that the second photoelectric conversion unit converts light that has passed through the second region of an exit pupil of the optical system into an electric charge and does not convert light that has passed through the first region of the exit pupil of the optical system into an electric charge.

16. 16. The imaging device according to claim 1, The pixel unit is disposed on a first semiconductor substrate, The image sensor, wherein the first readout section and the second readout section are disposed on a second semiconductor substrate that is stacked together with the first semiconductor substrate.

17. 17. The imaging device according to claim 16, The vertical control unit is disposed on the first semiconductor substrate.

18. 18. The imaging device according to claim 17, The vertical control unit is disposed on the second semiconductor substrate.

19. An imaging device comprising the imaging element according to claim 1 .

20. 20. The imaging device according to claim 19, When the vertical control unit has performed the first control, focus detection of the optical system is performed using the first signal and the second signal that have been subjected to signal processing by one of the first readout unit and the second readout unit; a control unit that generates image data using the first signal that has been subjected to signal processing in one of the first readout unit and the second readout unit and the second signal in the other of the first readout unit and the second readout unit when the vertical control unit performs the second control; An imaging device comprising:

Citation Information

Patent Citations

  • Solid-state imaging apparatus and imaging apparatus system using the same

    JP2007324985A

  • Driving method of imaging apparatus, imaging apparatus, and imaging system

    JP2017103571A

  • Image sensors

    US20140267861A1

  • Image pickup device and control method therefor, and imaging apparatus

    JP2017034606A