Image capture device, image capture element control method, and electronic device

Abstract

To enable AD conversion of pixel signals converted with different gains without increasing circuit scale.SOLUTION: An imaging device includes: a plurality of pixels arranged in a matrix; a plurality of output lines including a first output line and a second output line, disposed in each row; a plurality of pieces of signal processing means configured for each of the plurality of output lines and switchable between connection and disconnection to each of the plurality of output lines; and control means. Each of the plurality of pixels includes: a photoelectric conversion element; an FD unit for converting a charge transferred from the photoelectric conversion element to voltage; and FD expansion means that are configured in parallel with the FD unit with respect to the photoelectric conversion element and that can switch between connection and disconnection to expand a capacity of the FD unit. The control means controls which of the plurality of output lines the voltage converted by the FD unit is output to, and also the connection and the disconnection of the FD expansion means, and controls the connection and the disconnection between the plurality of output lines and the plurality of signal processing means.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to an image sensor, a control method thereof, and an electronic device. [Background technology]

[0002] Patent Document 1 proposes an imaging element that converts electric charges generated in a photoelectric conversion element by one exposure into voltage using floating diffusion (FD) sections with different capacitances, and amplifies and reads out the electric charges with multiple different gains. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-22921 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the conventional technology disclosed in Patent Document 1, when pixel signals with different gains that have been converted into voltages using FD sections with different capacities are subjected to AD conversion, the capacity of the memory that stores the conversion results increases, resulting in an increase in the circuit size.

[0005] The present invention has been made in consideration of the above problems, and aims to enable AD conversion of pixel signals that have been converted to voltages with different gains in FD sections of different capacities, without increasing the circuit size. [Means for solving the problem]

[0006] In order to achieve the above-mentioned object, the imaging element of the present invention has a plurality of pixels arranged in a matrix, a plurality of output lines including a first output line and a second output line arranged in each column, a plurality of signal processing means configured for each of the plurality of output lines and capable of switching between connection and disconnection to each of the plurality of output lines, and a control means, wherein each of the plurality of pixels has a photoelectric conversion element, an FD section for converting an electric charge transferred from the photoelectric conversion element into a voltage, and an FD expansion means configured in parallel with the FD section with respect to the photoelectric conversion element and capable of switching between connection and disconnection for expanding the capacity of the FD section, and the control means controls to which of the plurality of output lines the voltage converted by the FD section is output, and controls the connection and disconnection of the FD expansion means, and the connection and disconnection between the plurality of output lines and the plurality of signal processing means. Effect of the Invention

[0007] According to the present invention, it is possible to perform AD conversion of pixel signals converted with different gains without increasing the circuit scale. [Brief description of the drawings]

[0008] [Figure 1] 1 is a block diagram showing a schematic configuration of an imaging apparatus according to an embodiment of the present invention. [Diagram 2] FIG. 1 is a block diagram showing a configuration of an image sensor according to an embodiment. [Diagram 3] FIG. 2 is a circuit diagram showing a circuit configuration of a pixel according to the embodiment. [Figure 4] FIG. 4 is a circuit diagram showing a circuit configuration of a column signal processing unit according to the embodiment. [Diagram 5] 5 is a timing chart showing a first control according to the embodiment. [Figure 6] 6 is a timing chart showing a second control according to the embodiment. [Figure 7] 6 is a timing chart showing a third control according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the invention according to the claims. Although the embodiments describe a number of features, not all of these features are essential to the invention, and the features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.

[0010] 1 is a block diagram showing a schematic configuration of an image capturing device 100 according to an embodiment of the present invention. Note that the image capturing device 100 may be any electronic device equipped with a camera function, and may be, for example, a camera such as a digital camera or a digital video camera, a camera-equipped mobile phone, a camera-equipped computer, a game machine, or the like.

[0011] In FIG. 1, the photographing lens 101 is an interchangeable lens unit that can be attached to the main body of the imaging device 100, or a lens section built into the main body, and is composed of a lens group including multiple lenses such as a focus lens and a zoom lens, and an aperture, etc.

[0012] The image sensor 102 is composed of a CMOS image sensor or a CCD image sensor having multiple pixels, and performs photoelectric conversion at each pixel on the optical image of the subject formed by the photographing lens 101 to generate an electric charge according to the amount of incident light. The image sensor 102 can be driven by at least two driving methods. One is a driving method in which a single gain is applied to a voltage signal corresponding to the electric charge generated at each pixel in one exposure, and one image signal is output. The other is a driving method in which a plurality of different gains are applied to a voltage signal corresponding to the electric charge generated at each pixel in one exposure, and multiple image signals are output. The image sensor 102 also has an electronic shutter function, such as a rolling shutter, that adjusts the amount of light incident on each pixel, and is capable of controlling the exposure time of the subject image.

[0013] The image acquisition unit 103 acquires the image signal output from the image sensor 102, temporarily holds the acquired image signal, and performs photometry using the acquired image signal.

[0014] The image processing unit 104 performs various signal processing such as noise reduction processing, gamma processing, color signal processing, and exposure correction processing on the image signal held in the image acquisition unit 103, and outputs the processed image signal. The image processor 104 also generates a high dynamic range (HDR) image using any synthesis method. For example, there is a synthesis method in which an image signal amplified with a high gain (amplification rate) is used for image parts below a predetermined signal level, and an image signal amplified with a low gain (amplification rate) is used for image parts (bright, blown-out parts) that exceed the predetermined signal level. It is preferable that random noise in dark areas is suppressed in the synthesized image.

[0015] The image recording unit 105 records the image signal processed by the image processing unit 104 in a storage device or storage medium. As the storage device or storage medium, for example, a memory device that can be attached to the imaging device 100 can be used.

[0016] The operation unit 106 includes operation members such as a release button, a mode switching dial, and a zoom operation lever, as well as a touch panel, and the like, and a user can input various instructions to the imaging device 100 by operating the operation unit 106. User input via the operation unit 106 is notified to a system control unit 110.

[0017] The storage unit 107 is a storage unit that stores the contents of instructions given by the user to the imaging device 100, and is configured of an electrically erasable and recordable non-volatile memory. The display unit 108 is for displaying the captured image, information at the time of capturing, a user interface for operation by the operation unit 106, and is configured, for example, with a TFT-LCD. In addition, by providing a touch panel on the front surface of the display unit 108, the display unit 108 may constitute a part of the operation unit 106 together with the display unit 108.

[0018] The system control unit 110 controls an image sensor control unit 111 and a lens control unit 112 based on the image signal and photometry results held in the image acquisition unit 103 and on user input via the operation unit . The image sensor control unit 111 controls the driving of the image sensor 102 in accordance with a control signal from the system control unit 110 . The lens control unit 112 controls the driving of the photographing lens 101 in accordance with a control signal from the system control unit 110 .

[0019] Next, the configuration of the image sensor 102 will be described. FIG. 2 is a block diagram showing a schematic configuration of the image sensor 102 in this embodiment, and will be described here as a CMOS image sensor.

[0020] The image sensor 102 includes a pixel region 201 having a plurality of pixels 200, a vertical scanning section 202, an addition circuit 210, column signal processing sections 203a and 203b, a horizontal scanning section 207, an output section 209, and a timing section 211.

[0021] A plurality of pixels 200 included in a pixel region 201 are arranged in a matrix in the horizontal direction (row direction) and the vertical direction (column direction). 2, each of the multiple pixels 200 is represented as "P([row number], [column number])," such that the pixel 200 in the first row and first column is P(1,1), and the pixel 200 in the eighth row and sixth column is P(8,6). Also, the arrangement of the pixels 200 arranged in the pixel region 201 in FIG. 2 is illustrated as 8 rows by 6 columns, but is usually composed of more pixels 200.

[0022] A plurality of pixels 200 are arranged across the entire pixel region 201, and are covered with a Bayer filter in which R (red) filters and G (green) filters are alternately arranged on the odd-numbered rows of pixels 200, and G (green) filters and B (blue) filters are alternately arranged on the even-numbered rows of pixels 200. In other words, the color filters are arranged to form a pattern that is repeated in a 2×2 array (2 rows and 2 columns).

[0023] In the pixel region 201, pixel control lines 221 are commonly connected for each row of pixels 200 (pixel rows), and vertical signal lines 231 are commonly connected for each column of pixels 200 (pixel columns). In this embodiment, as described below, it is assumed that two vertical signal lines 231a, 231b are connected to one column of pixels 200, but the present invention is not limited to this and the number of vertical signal lines arranged in each column may be at least two.

[0024] The vertical scanning unit 202 selects the pixels 200 in the pixel region 201 one row at a time or two rows at a time, and controls the reset operation and readout operation of the selected pixel rows by transmitting drive control signals via pixel control lines 221. The pixel control lines 221 are commonly connected to the multiple pixels 200 arranged in each row, and include multiple control lines for supplying drive control signals, such as a transfer signal pTX, an FD extension signal pFDext, a reset signal pRS, and selection signals pSEL1 and pSEL2, which will be described later.

[0025] The pixel signals of a pixel row selected by the vertical scanning unit 202 via the pixel control line 221 are read out to vertical signal lines 231a, 231b corresponding to each pixel 200. The column signal processing units 203a, 203b are provided for each vertical signal line 231a, 231b, respectively, and perform addition processing and column signal processing, which will be described later, on the pixel signals in row units supplied via the vertical signal lines 231a, 231b, and store the processed pixel signals. In this embodiment, a case will be described in which two column signal processing units 203a, 203b are provided for each pixel column, similar to the vertical signal lines 231a, 231b.

[0026] The column signal processing units 203a and 203b are each connected to the horizontal scanning unit 207 by a corresponding column selection line 251. The horizontal scanning unit 207 selects the column signal processing units 203a and 203b for each column via the column selection line 251, thereby controlling the transfer of digitized pixel signals stored in the column signal processing units 203a and 203b to the output unit 209 via a horizontal output line 261.

[0027] The timing unit 211 outputs various signals such as clock signals and control signals necessary for the operation of each unit of the image sensor 102. The timing unit 211 is connected to a signal line 271 that sends a signal to the vertical scanning unit 202, a control line 281 that sends a signal to the column signal processing units 203a and 203b, and a control line 285 that sends a signal to the horizontal scanning unit 207.

[0028] FIG. 3 is a circuit diagram showing the circuit configuration of each pixel 200 of the image sensor 102 according to the embodiment, in which one of the pixels 200 constituting a pixel region 201 is representatively shown by a rectangular dotted line.

[0029] The pixel 200 is connected to other circuits by a pixel control line 221 and vertical signal lines 231a and 231b. The vertical signal lines 231a and 231b are connected to the load circuits and column signal processors 203a and 203b, respectively, and are also connected in common to the multiple pixels 200 arranged in each column to transmit pixel signals.

[0030] The photoelectric conversion element (PD) 301 is a photodiode that converts light into an electric charge and accumulates the converted electric charge. The PD 301 has a PN junction whose P side is grounded and whose N side is connected to the source of the transfer transistor 302.

[0031] The transfer transistor 302 has a drain connected to a floating diffusion (FD) section 303 and a gate controlled by a transfer signal pTX, thereby controlling the transfer of charges from the PD 301 to the FD section 303. The FD unit 303 has one side grounded and accumulates the charge when converting the charge transferred from the PD 301 into a voltage. Hereinafter, the connection point between the drain of the transfer transistor 302 and the other side (non-grounded side) of the FD unit 303 is referred to as an FD node 300.

[0032] The FD extension transistor 304 is a MOS transistor whose gate is controlled by an FD extension signal pFDext, whose source is connected to the FD section 303 , and whose drain is connected to the reset transistor 305 . The reset transistor 305 has a gate controlled by a reset signal pRS, a drain connected to a power supply voltage Vdd, and a source connected to the FD extension transistor 304 .

[0033] By controlling both the FD extension transistor 304 and the reset transistor 305 to the ON state, the potential of the FD node 300 is reset to the power supply voltage Vdd. On the other hand, when both the FD extension transistor 304 and the reset transistor 305 are in the OFF state, the charge transferred from the PD 301 in the FD section 303 is converted into a voltage.

[0034] Furthermore, when the FD extension transistor 304 is in an ON state and the reset transistor 305 is in an OFF state, the FD extension transistor 304 functions as a storage section having a storage capacitance capable of holding charge. At this time, the FD extension transistor 304 and the FD section 303 are grounded in parallel to the substrate, so that the capacitance seen from the FD node 300 is the capacitance of the FD section 303 plus the capacitance (extension capacitance) of the FD extension transistor 304. Hereinafter, this capacitance will be referred to as the "FD addition capacitance CFDadd." Therefore, in this case, in the FD node 300, the charge transferred from the PD 301 is converted into a voltage using the FD addition capacitance CFDadd.

[0035] The capacitance at which the PD 301 saturates is set to be approximately equal to the amount of charge that can maintain the linearity of the charge-voltage conversion in the FD addition capacitance CFDadd. This setting state can be expressed as PD capacitance: FD addition capacitance = 1:1. Furthermore, the capacitances when expressed as a ratio based on the capacitance of the FD section 303 are set as FD capacitance: FD extension transistor capacitance: FD addition capacitance: PD capacitance = 1:3:4:4.

[0036] Furthermore, the conversion gain of the charge-voltage conversion in the FD unit 303 set as above is hereinafter expressed as 1 (or x1) as a normalized value. In this case, since the FD addition capacitance CFDadd is four times the capacitance of the FD unit 303, the conversion gain of the charge-voltage conversion when the FD addition capacitance CFDadd is used can be expressed as 1 / 4 (or x1 / 4).

[0037] The set values ​​of the capacitances are not limited to the above-mentioned FD capacitance:FD extension transistor capacitance:FD addition capacitance=1:3:4, as long as the capacitance of the FD extension transistor 304 is set to 1 or more. For example, the capacitance of the FD:FD extension transistor capacitance:FD addition capacitance=1:7:8 may be set. In this case, the conversion gain of the charge-voltage conversion in the FD addition capacitance CFDadd is 1 / 8 times (or x1 / 8).

[0038] In the following description, charge-voltage conversion using only the FD unit 303 is referred to as "high gain conversion", and charge-voltage conversion using the FD addition capacitance CFDadd is referred to as "low gain conversion".

[0039] The driving transistor 306 is a transistor that constitutes an in-pixel amplifier, and has a gate connected to the FD section 303, a drain connected to a power supply voltage Vdd, and a source connected to the drains of selection transistors (selection switches) 307 and 308.

[0040] The selection transistors 307 and 308 have gates controlled by selection signals pSEL1 and pSEL2, respectively, and sources connected to the vertical signal lines 231a and 231b, respectively. When the selection transistor 307 is in the ON state, it is connected to the vertical signal line 231a, and when it is in the OFF state, it is disconnected. When the selection transistor 308 is in the ON state, it is connected to the vertical signal line 231b, and when it is in the OFF state, it is disconnected. As a result, the selection transistors 307 and 308 output a voltage corresponding to the voltage of the FD node 300 from the drive transistor 306 to the vertical signal lines 231a and 231b as an output signal (reset signal or pixel signal) of the pixel 200.

[0041] The load transistors 311 and 312 of the load circuits provided on the vertical signal lines 231a and 231b respectively have their gates and sources grounded and their drains connected to the vertical signal lines 231a and 231b. The load transistors 311 and 312, together with the drive transistors 306 of the pixels 200 in the columns connected to the vertical signal lines 231a and 231b, form a source follower circuit that functions as an in-pixel amplifier. Usually, when a signal from the pixel 200 is output, the load transistors 311 and 312 are operated as constant current sources with their gates grounded.

[0042] In this embodiment, transistors other than the drive transistor 306 and the load transistors 311, 312 act as switches, and are conductive (ON state) when the control line connected to the gate is High (hereinafter referred to as "H"), and are cut off (OFF state) when the control line is Low (hereinafter referred to as "L").

[0043] FIG. 4 is a circuit diagram showing a circuit configuration of the column signal processing units 203a and 203b of the image sensor 102 according to the embodiment of the present invention.

[0044] Fig. 4(a) shows a configuration in which two different rows of pixels 200 are connected to two vertical signal lines 231a, 231b provided in each pixel column, respectively, and two rows are read out simultaneously. On the other hand, Fig. 4(b) shows a configuration in which the same pixels 200 are connected to two vertical signal lines 231a, 231b provided in each pixel column, and one row is read out at a time. The components in Fig. 4(a) and Fig. 4(b) are the same, but the connections between the pixels 200 and the vertical signal lines 231a, 231b by the selection transistors 307 and 308 are different.

[0045] In the following description, when it is necessary to distinguish between columns, column numbers n and (n+1) are written after the vertical signal lines 231a and 231b.

[0046] Similarly, two column signal processing units 203a and 203b are provided for each pixel column, and therefore, in the following description, when it is necessary to distinguish between them, the column numbers n and (n+1) are written after the column signal processing units 203a and 203b. Each column signal processing unit 203a and 203b includes a comparator 402, a counter circuit 403, a latch circuit 404, and an arithmetic circuit 405. As described below, the column signal processing units 203a and 203b function as AD conversion circuits.

[0047] The addition circuit 210 is a circuit that, when in an ON state, adds up pixel signals output to vertical signal lines 231 of columns adjacent in the horizontal direction. The comparator 402 is a circuit that outputs a comparison result of two input signals, and changes its output signal from High to Low when, for example, the magnitude relationship between the two input signals is reversed. The vertical signal line 231a or 231b and a ramp wave signal line that outputs a ramp wave Vrmp are connected to the comparator 402 as two input signals via a connection switch 401. The connection switch 401 is controlled to be ON / OFF (connected / disconnected) by control signals pComp1 to pComp4, and compares the input signals when in the ON state.

[0048] The ramp wave Vrmp output by the timing unit 211 to the ramp signal line is a triangular wave that gradually changes from an initial voltage. It is preferable that the amplitude of the ramp wave Vrmp has a sufficient margin with respect to the saturation amplitude of the pixel signal input to the comparator 402. The comparator 402 outputs a comparison result at the point in time when the gradually changing ramp wave Vrmp intersects with the signal on the vertical signal line 231a or 231b.

[0049] The counter circuit 403 operates the counter based on a clock signal pCNT supplied from a connected counter control line. The counter circuit 403 starts counting in synchronization with the start of the ramp wave Vrmp, and outputs a count value at the time of receiving a comparison result signal from the comparator 402. The output count value (discrete value) corresponds to a signal obtained by digitizing the pixel signals received by the column signal processing units 203a and 203b via the vertical signal lines 231a and 231b.

[0050] The latch circuit 404 temporarily holds the count value output by the counter circuit 403, and outputs the held count value based on a control signal pLTC via a connected latch control line.

[0051] The arithmetic circuit 405 stores the count value output by the latch circuit 404 as a digital pixel signal based on a control signal pCAL via a connected arithmetic control line. Then, the arithmetic circuit 405 outputs the stored digital pixel signal to a digital output line DSig based on a control signal pH via a corresponding column selection line 251.

[0052] As described above, each of the column signal processing sections 203a and 203b configures an AD conversion circuit using the comparator 402, the counter circuit 403, the latch circuit 404, and a ramp wave signal line.

[0053] 4. As described above, the control line 281 connected from the timing unit 211 in FIG. 2 to the column signal processing units 203a and 203b includes the ramp signal line, counter control line, latch control line, and calculation control line in FIG.

[0054] ● First control (non-additive, one type of gain, two-row simultaneous readout) Next, the first control will be described with reference to Fig. 4(a) and Fig. 5. In the first control, the addition circuit 210 is turned off to not add pixel signals between columns, and signals output with one of the gains of high gain conversion and low gain conversion are AD converted simultaneously for two rows.

[0055] First, at timing t1, the m-th row selection signal pSEL1(m) is set to H, the selection signal pSEL2(m) is set to L, and the (m+1)-th row selection signal pSEL1(m+1) is set to L, and the selection signal pSEL2(m+1) is set to H, to control the selection transistors 307 and 308 in FIG. 3. As a result, pixel P(m,n) is connected to the vertical signal line 231a(n), and pixel P(m+1,n) is connected to the vertical signal line 231b(n). Also, pixel P(m,n+1) is connected to the vertical signal line 231a(n+1), and pixel P(m+1,n+1) is connected to the vertical signal line 231b(n+1).

[0056] Moreover, the control signals pComp1 to pComp4 are set to H, and the comparators 402 in the column signal processing units 203a and 203b are connected to the vertical signal lines 231a and 231b and the ramp wave signal line.

[0057] In this state, the FD extension signal pFDext and the reset signal pRS in the mth row and the (m+1)th row are set to H, the FD extension transistor 304 and the reset transistor 305 are both controlled to the ON state, and the potential of the FD node 300 is reset to the power supply voltage Vdd. After that, at timing t2, the FD extension signal pFDext and the reset signal pRS are set to L, and in this state the ramp signal Vramp is changed, whereby AD conversion is performed in each column signal processing unit 203a, 203b, and the count value (cn) is stored in each arithmetic circuit 405 as a reset release signal.

[0058] Next, at timing t3, the transfer signal pTX is set to H to turn on the transfer transistor 302, and charge is transferred from the PD 301 to the FD unit 303. Thereafter, the ramp signal Vramp is changed to perform AD conversion in each column signal processing unit 203a, 203b, and the count value (cs) is stored in each arithmetic circuit 405 as a pixel signal.

[0059] Furthermore, the arithmetic circuit 405 subtracts the count value (cn) of the reset release signal from the count value (cs) of the pixel signal to obtain an image signal.

[0060] As described above, the two vertical signal lines 231 in each pixel column make it possible to simultaneously read out pixel signals from two rows.

[0061] When the reset signal and the pixel signal are AD converted in each of the column signal processing units 203a and 203b, the FD extension transistor 304 is set to the OFF state. This allows high-gain conversion to be performed, but low-gain conversion can be performed by setting the FD extension transistor 304 to the ON state according to the gain setting at the time of shooting.

[0062] ● Second control (non-additive, two types of gain, one-line readout) Next, the second control will be described with reference to Fig. 4(b) and Fig. 6. In the second control, the addition circuit 210 is turned off to not add pixel signals between columns, and the signals output by the two types of high gain conversion and low gain conversion are AD converted in parallel for one row.

[0063] First, at timing t11, the m-th row selection signals pSEL1(m) and pSEL2(m) are set to H, and the (m+1)-th row selection signals pSEL1(m+1) and pSEL2(m+1) are set to L, to control the selection transistors 307 and 308 in FIG. 3. As a result, pixel P(m,n) is connected to both vertical signal line 231a(n) and vertical signal line 231b(n). Furthermore, pixel P(m,n+1) is connected to both vertical signal line 231a(n+1) and vertical signal line 231b(n+1).

[0064] Moreover, the control signals pComp1 and pComp3 are set to H, and the control signals pComp2 and pComp4 are set to L, and the comparators 402 of each column signal processing unit 203a(n) and 203a(n+1) are connected to the vertical signal line 231a and the ramp wave signal line. Furthermore, the FD extension signal pFDext and the reset signal pRS are set to H, and both the FD extension transistor 304 and the reset transistor 305 are controlled to the ON state, and the potential of the FD node 300 is reset to the power supply voltage Vdd. In this state, the ramp signal Vramp is changed to perform AD conversion in the column signal processing units 203a(n) and 203a(n+1), and the count value (low gain reset value cn-l) of the reset release signal of the low gain conversion is stored in the arithmetic circuit 405.

[0065] Next, at timing t12, the control signals pComp1 and pComp3 are set to L and the control signals pComp2 and pComp4 are set to H, and the comparators 402 of each column signal processing unit 203b(n) and 203b(n+1) are connected to the vertical signal line 231b and the ramp wave signal line. In addition, the FD extension signal pFDext is set to L to turn the FD extension transistor 304 to the OFF state. In this state, the ramp signal Vramp is changed to perform AD conversion in the column signal processing units 203b(n) and 203b(n+1), and the count value of the reset release signal for high gain conversion (high gain reset value cn-h) is stored in the arithmetic circuit 405.

[0066] Next, at timing t13, the control signals pComp1 and pComp3 are still set to L and the control signals pComp2 and pComp4 are still set to H, and the comparators 402 of each column signal processing unit 203b(n) and 203b(n+1) are connected to the vertical signal line 231b and the ramp wave signal line. Then, the reset signal pRS is set to L to turn the reset transistor 305 to the OFF state, and the transfer signal pTX is set to H to turn the transfer transistor 302 to ON, and charge is transferred from the PD 301 to the FD unit 303. Thereafter, the ramp signal Vramp is changed to perform AD conversion in the column signal processing units 203b(n) and 203b(n+1), and the count value of the pixel signal of the high gain conversion (high gain pixel value cs-h) is stored in the arithmetic circuit 405.

[0067] Furthermore, at timing t14, the control signals pComp1 and pComp3 are set to H and the control signals pComp2 and pComp4 are set to L, and the comparators 402 of each column signal processing unit 203a(n) and 203a(n+1) are connected to the vertical signal line 231a and the ramp wave signal line. Then, the FD extension signal pFDext is set to H, and the FD extension transistor 304 is turned ON again. In this state, the ramp signal Vramp is changed to perform AD conversion in the column signal processing units 203a(n) and 203a(n+1), and the count value of the pixel signal subjected to low-gain conversion (low-gain pixel value cs-l) is stored in the arithmetic circuit 405.

[0068] By the above control, the arithmetic circuit 405 of the column signal processing unit 203a for each column stores two count values: a count value cn-l of the reset signal after low gain conversion and a count value cs-l of the pixel signal after low gain conversion. Also, the arithmetic circuit 405 of the column signal processing unit 203b for each column stores two count values: a count value cn-h of the reset signal after high gain conversion and a count value cs-h of the pixel signal after high gain conversion.

[0069] If AD conversion of both the high gain converted and low gain converted signals is performed by the same column signal processing units 203a and 203b, the number of count values ​​stored in the arithmetic circuit 405 will be four, which increases the circuit scale.

[0070] In contrast, in this embodiment, AD conversion of the high-gain converted and low-gain converted signals is performed separately in the column signal processing unit 203a and the column signal processing unit 203b, so that the number of count values ​​stored in the arithmetic circuit 405 can be reduced to two. This is the same number as in the case of AD conversion of pixel signals converted at a single gain into voltages by an FD with a single capacity in FIG. 4(a), so that the circuit scale can be reduced.

[0071] ●Third control (addition, two types of gain, two-line readout) Next, the third control will be described with reference to Fig. 4(a) and Fig. 7. In the third control, the addition circuit 210 is turned ON, and when pixel signals between adjacent columns are added, the signals output by the two types of high gain conversion and low gain conversion are AD converted simultaneously for two rows.

[0072] First, at timing t21, the m-th row selection signal pSEL1(m) is set to H, the selection signal pSEL2(m) is set to L, and the (m+1)-th row selection signal pSEL1(m+1) is set to L, and the selection signal pSEL2(m+1) is set to H, to control the selection transistors 307 and 308 in FIG. 3. As a result, pixel P(m,n) is connected to vertical signal line 231a(n), and pixel P(m+1,n) is connected to vertical signal line 231b(n). Also, pixel P(m,n+1) is connected to vertical signal line 231a(n+1), and pixel P(m+1,n+1) is connected to vertical signal line 231b(n+1).

[0073] Furthermore, the adder circuit 210 is turned ON to add the pixel signal of the vertical signal line 231a(n) to the pixel signal of the vertical signal line 231a(n+1) and to add the pixel signal of the vertical signal line 231b(n) to the pixel signal of the vertical signal line 231b(n+1). As a result, the pixel signals output from the pixel P(m,n) and pixel P(m,n+1) of the mth row are added, and the pixel signals output from the pixel P(m+1,n) and pixel P(m+1,n+1) of the (m+1)th row are added.

[0074] Moreover, the control signals pComp1 and pComp2 are set to H and the control signals pComp3 and pComp4 are set to L, and the comparator 402 of the column signal processing unit 203a(n) is connected to the vertical signal line 231a(n) and the ramp signal line. Moreover, the comparator 402 of the column signal processing unit 203b(n) is connected to the vertical signal line 231b(n) and the ramp signal line. Furthermore, the FD extension signal pFDext and the reset signal pRS are set to H, controlling both the FD extension transistor 304 and the reset transistor 305 to the ON state, and resetting the potential of the FD node 300 to the power supply voltage Vdd.

[0075] In this state, by changing the ramp signal Vramp, AD conversion is performed in the column signal processing unit 203a(n), and the count value (low gain reset value cn-l) of the low gain conversion addition reset release signal of the pixel P(m,n) and the pixel P(m,n+1) is stored in the arithmetic circuit 405. AD conversion is also performed in the column signal processing unit 203b(n), and the count value (low gain reset value cn-l) of the low gain conversion addition reset release signal of the pixel P(m+1,n) and the pixel P(m+1,n+1) is stored in the arithmetic circuit 405.

[0076] Next, at timing t22, the control signals pComp1 and pComp2 are set to L and the control signals pComp3 and pComp4 are set to H, connecting the comparator 402 of the column signal processing unit 203a(n+1) to the vertical signal line 231a(n+1) and the ramp signal line. Also, the comparator 402 of the column signal processing unit 203b(n+1) is connected to the vertical signal line 231b(n+1) and the ramp signal line. Furthermore, the FD extension signal pFDext is set to L, turning the FD extension transistor 304 to the OFF state.

[0077] In this state, by changing the ramp signal Vramp, AD conversion is performed in the column signal processing unit 203a(n+1) and the count value (high gain reset value cn-h) of the high gain conversion addition reset release signal of the pixel P(m,n) and the pixel P(m,n+1) is stored in the arithmetic circuit 405. AD conversion is also performed in the column signal processing unit 203b(n+1) and the count value (high gain reset value cn-h) of the high gain conversion addition reset release signal of the pixel P(m+1,n) and the pixel P(m+1,n+1) is stored in the arithmetic circuit 405.

[0078] Next, at timing t23, while the control signals pComp1 and pComp2 remain at L, the control signals pComp3 and pComp4 remain at H, and the FD extension signal pFDext remains at L, the reset signal pRS is set to L to turn the reset transistor 305 into the OFF state. Furthermore, the transfer signal pTX is set to H to turn the transfer transistor 302 ON, and charge is transferred from the PD 301 to the FD section 303.

[0079] Thereafter, the ramp signal Vramp is changed, and the column signal processing unit 203a(n+1) performs AD conversion on the sum pixel signal of pixels P(m,n) and P(m,n+1), and the count value (high gain pixel value cs-h) of the high gain converted sum pixel signal is stored in each calculation circuit 405. Similarly, the column signal processing unit 203b(n+1) performs AD conversion on the sum pixel signal of pixels P(m+1,n) and P(m+1,n+1), and the count value (high gain pixel value cs-h) of the high gain converted sum pixel signal is stored in each calculation circuit 405.

[0080] Furthermore, at timing t24, the control signals pComp1 and pComp2 are set to H and the control signals pComp3 and pComp4 are set to L, and the comparator 402 of the column signal processing unit 203a(n) is connected to the vertical signal line 231a(n) and the ramp wave signal line. Also, the comparator 402 of the column signal processing unit 203b(n) is connected to the vertical signal line 231b(n) and the ramp wave signal line. Furthermore, the FD extension signal pFDext is set to H, and the FD extension transistor 304 is turned ON again.

[0081] Thereafter, the ramp signal Vramp is changed, and the column signal processing unit 203a(n) performs AD conversion on the sum pixel signal of pixels P(m,n) and P(m,n+1), and stores the count value (low gain pixel value cs-l) of the low gain converted sum pixel signal in the arithmetic circuit 405. Similarly, the column signal processing unit 203b(n+1) performs AD conversion on the sum pixel signal of pixels P(m+1,n) and P(m+1,n+1), and stores the count value (low gain pixel value cs-l) of the low gain converted sum pixel signal in the arithmetic circuit 405.

[0082] As a result, the low-gain reset value cn-l and the low-gain pixel value cs-l are stored in the arithmetic circuits 405 of the column signal processing units 203a(n) and 203b(n). Also, the high-gain reset value cn-h and the high-gain pixel value cs-h are stored in the arithmetic circuits 405 of the column signal processing units 203a(n+1) and 203b(n+1).

[0083] In this way, when horizontal addition is performed by the adder circuit 210, high gain and low gain pixel signals can be processed simultaneously for two rows.

[0084] As described above, according to this embodiment, it is possible to perform AD conversion of pixel signals with different gains that have been converted into voltages by FDs with different capacities, without increasing the circuit scale of the image sensor.

[0085] In this embodiment, the addition is performed between adjacent columns, but the present invention is not limited to this. For example, the addition may be performed every other column. Furthermore, when converting to voltage with the same FD using the same circuit configuration and adding across multiple columns, it becomes possible to realize faster operations.

[0086] In the above example, the case where the FD extension transistor 304 and the reset transistor 305 are connected one by one has been described, but three or more FD extension transistors and reset switches may be further connected in parallel to control the on / off of a plurality of FD extension transistors. In this way, it is possible to perform AD conversion and output a signal using three or more types of gain.

[0087] <Other embodiments> The present invention may be applied to a system made up of a plurality of devices, or to an apparatus made up of a single device.

[0088] <Summary> The disclosure of this embodiment includes the following configuration.

[0089] (Configuration 1) A plurality of pixels arranged in a matrix; a plurality of output lines including a first output line and a second output line, the output lines being arranged in each column; a plurality of signal processing means each configured for each of the plurality of output lines and capable of switching between connection and non-connection to each of the plurality of output lines; A control means, Each of the plurality of pixels is A photoelectric conversion element; an FD unit for converting the charges transferred from the photoelectric conversion element into a voltage; an FD expansion means configured in parallel with the FD section with respect to the photoelectric conversion element and capable of switching between connection and non-connection in order to expand the capacity of the FD section; The image sensor is characterized in that the control means controls to which of the multiple output lines the voltage converted by the FD section is output, and also controls the connection and disconnection of the FD extension means, and the connection and disconnection between the multiple output lines and the multiple signal processing means.

[0090] (Configuration 2) The imaging element described in configuration 1, characterized in that the control means controls to connect different signal processing means to the output line when the FD extension means is connected and when it is not connected.

[0091] (Configuration 3) The imaging element can be driven by a first control, and in the first control, The control means Controlling the voltage converted by the FD unit of the pixel in a predetermined first row to be output to the first output line; Controlling the voltage converted by the FD unit of the pixel in a predetermined second row different from the first row to be output to the second output line; Controlling the plurality of signal processing means to connect to the plurality of output lines. 3. The imaging element according to configuration 1 or 2.

[0092] (Configuration 4) The imaging element can be driven under a second control, and in the second control, The control means Controlling the voltage converted by the FD unit of a pixel in a predetermined first row to be output to the first output line and the second output line; connecting the FD extension means, connecting the first output line to the corresponding signal processing means, and disconnecting the second output line from the corresponding signal processing means; Disconnecting the FD extension means, disconnecting the first output line from the corresponding signal processing means, and connecting the second output line to the corresponding signal processing means. 4. The imaging device according to any one of configurations 1 to 3.

[0093] (Configuration 5) The control means is further capable of switching between connection and non-connection of the plurality of output lines between a plurality of predetermined columns, The imaging element can be driven by a third control, and in the third control, The control means connecting the output lines between the predetermined number of columns; Controlling the voltage converted by the FD unit of the pixel in a predetermined first row to be output to the first output line; Controlling the voltage converted by the FD unit of the pixel in a predetermined second row different from the first row to be output to the second output line; connecting the FD extension means, connecting an output line connected to the first row among the plurality of output lines to a corresponding signal processing means, and disconnecting output lines connected to rows other than the first row from a corresponding signal processing means; disconnecting the FD extension means, connecting the output lines connected to the second row among the plurality of output lines to the corresponding signal processing means, and disconnecting the output lines connected to rows other than the second row from the corresponding signal processing means; 5. The imaging device according to any one of configurations 1 to 4.

[0094] (Configuration 6) Each of the pixels includes a plurality of selection switches for switching between connection and disconnection between the FD unit and each of the plurality of output lines, each of the signal processing means includes a connection switch for switching between connection and non-connection with the corresponding output line; 6. The imaging element according to any one of configurations 1 to 5, wherein the control means switches between connection and non-connection by controlling on and off of the selection switch and the connection switch.

[0095] (Configuration 7) An imaging element according to any one of configurations 1 to 6, A processing means for processing a signal output from the imaging element; 1. An electronic device comprising:

[0096] (Configuration 8) A plurality of pixels arranged in a matrix; a plurality of output lines including a first output line and a second output line, the output lines being arranged in each column; a plurality of signal processing means each configured for each of the plurality of output lines and capable of switching between connection and non-connection to each of the plurality of output lines; Each of the plurality of pixels is A photoelectric conversion element; an FD unit for converting the charges transferred from the photoelectric conversion element into a voltage; an FD expansion means configured in parallel with the FD section with respect to the photoelectric conversion element and capable of switching between connection and non-connection in order to expand the capacity of the FD section; A method for controlling an imaging element having Control is performed so that different signal processing means are connected to the output line depending on whether the FD extension means is connected or not. 23. A method for controlling an imaging element comprising the steps of:

[0097] The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0098] 100: imaging element, 200: pixel, 202: vertical scanning section, 203a, 203b: column signal processing section, 210: adder circuit, 211: timing section, 231a, 231b: vertical signal line, 300: FD node, 301: photoelectric conversion element, 302: transfer transistor, 303: FD, 304: FD extension transistor, 305: reset transistor, 307, 308: selection transistor, 402: comparator, 403: counter, 404: latch circuit, 405: arithmetic circuit

Claims

1. A plurality of pixels arranged in a matrix; a plurality of output lines arranged in each column, through which signals of the plurality of pixels are output; a plurality of signal processing means provided in a one-to-one correspondence with the plurality of output lines, each of which is switchable between connection and non-connection to each of the plurality of output lines; a control means; Each of the plurality of pixels is a photoelectric conversion element; an FD unit for converting the charges transferred from the photoelectric conversion element into a voltage; an FD expansion unit capable of switching between connection and non-connection for expanding the capacity of the FD unit; The imaging device is characterized in that the control means controls connection and disconnection of the FD extension means and connection and disconnection between the plurality of output lines and the plurality of signal processing means.

2. 2. The imaging device according to claim 1, wherein the control means controls the signal processing means so that different signal processing means are connected to the output line when the FD extension means is connected and when it is not connected.

3. The imaging device can be driven by a first control, and in the first control, The control means controlling the pixel signals of a predetermined first row to be output to a first output line among the plurality of output lines; controlling the pixel signals of a predetermined second row different from the first row to be output to a second output line among the plurality of output lines; Controlling the plurality of signal processing means so that they are connected to the plurality of output lines, respectively.

2. The imaging device according to claim 1.

4. The imaging device can be driven under a second control, and under the second control, The control means controlling the pixel signals of a predetermined first row to be output to a first output line and a second output line among the plurality of output lines; connecting the FD expansion means, connecting the first output line and the corresponding signal processing means, and disconnecting the second output line and the corresponding signal processing means; disconnecting the FD expansion means, disconnecting the first output line from the corresponding signal processing means, and connecting the second output line to the corresponding signal processing means; 2. The imaging device according to claim 1.

5. the control means is further capable of switching between connection and disconnection of the plurality of output lines between a plurality of predetermined columns, The imaging device can be driven by a third control, and in the third control, The control means connecting the plurality of output lines between the predetermined plurality of columns; controlling the pixel signals of a predetermined first row to be output to a first output line among the plurality of output lines; controlling the pixel signals of a predetermined second row different from the first row to be output to a second output line among the plurality of output lines; connecting the FD expansion means, connecting the output lines connected to the first row among the plurality of output lines to the corresponding signal processing means, and disconnecting the output lines connected to rows other than the first row from the corresponding signal processing means; disconnecting the FD expansion means, connecting the output lines connected to the second row among the plurality of output lines to the corresponding signal processing means, and disconnecting the output lines connected to rows other than the second row from the corresponding signal processing means; 2. The imaging device according to claim 1.

6. each of the pixels includes a plurality of selection switches for switching between connection and disconnection between the FD unit and each of the plurality of output lines; each of the signal processing means includes a connection switch for switching between connection and disconnection with the corresponding output line; 2. The imaging device according to claim 1, wherein the control means controls the on and off of the selection switch and the connection switch to switch between connection and non-connection.

7. An imaging device according to any one of claims 1 to 6; a processing means for processing a signal output from the imaging device; An electronic device comprising:

8. A plurality of pixels arranged in a matrix; a plurality of output lines arranged in each column, through which signals of the plurality of pixels are output; a plurality of signal processing means provided in a one-to-one correspondence with the plurality of output lines, each of which is switchable between connection and non-connection to each of the plurality of output lines; Each of the plurality of pixels is a photoelectric conversion element; an FD unit for converting the charges transferred from the photoelectric conversion element into a voltage; an FD expansion unit capable of switching between connection and non-connection for expanding the capacity of the FD section; A method for controlling an imaging element comprising: Control is performed so that different signal processing means are connected to the output line depending on whether the FD expansion means is connected or not.

10. A method for controlling an imaging element, comprising:

Images