Solid-state imaging device
Patent Information
- Application Number
- JP2022530065
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-06-08
- Filing Date
- 2021-05-11
- Publication Date
- 2025-02-19
- Estimated Expiration
- 2041-05-11
Smart Images

Figure 0007633250000001 
Figure 0007633250000002 
Figure 0007633250000003
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a solid-state imaging device. [Background technology]
[0002] There is a CMOS (Complementary Metal Oxide Semiconductor) image sensor that performs analog-to-digital (AD) conversion of a pixel signal by using a comparator to compare an analog pixel signal with a linearly changing reference signal and counting the time it takes for the reference signal to cross the pixel signal. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2018-148541 A [Patent Document 1] JP 2019-165313 A Summary of the Invention [Problem to be solved by the invention]
[0004] However, in the AD converters of conventional image sensors, the dynamic range of the comparator is relatively narrow, making it difficult to perform AD conversion on illuminating light with a wide range of illuminance.
[0005] Therefore, an object of the solid-state imaging device according to the present disclosure is to provide a solid-state imaging device equipped with an AD converter having a wide dynamic range. [Means for solving the problem]
[0006] A solid-state imaging element according to one aspect of the present disclosure comprises a pixel section including a plurality of pixels, a pixel signal line transmitting pixel signals of the pixels, a reference signal line transmitting a reference signal to be compared with the pixel signal, a first comparator outputting a first output signal corresponding to the pixel signal based on a voltage difference between the pixel signal and the reference signal, a second comparator outputting a second output signal corresponding to the pixel signal based on a voltage difference between the pixel signal and the reference signal, a first capacitance section provided between the pixel signal line or the reference signal line and the first comparator and set to a first gain, and a second capacitance section provided between the pixel signal line or the reference signal line and the second comparator and set to a second gain.
[0007] The first capacitance section may include a first input capacitance element provided between the reference signal line and the first comparator, and a second input capacitance element provided between the pixel signal line and the first comparator, and the second capacitance section may include a third input capacitance element provided between the reference signal line and the second comparator, and a fourth input capacitance element provided between the pixel signal line and the second comparator.
[0008] The capacitance ratio between the first input capacitance element and the second input capacitance element may be different from the capacitance ratio between the third input capacitance element and the fourth input capacitance element.
[0009] The first and third input capacitance elements may have substantially the same capacitance, and the second and fourth input capacitance elements may have different capacitances.
[0010] The gain of the first capacitive section may be determined by a capacitance ratio between the first input capacitive element and the second input capacitive element, and the gain of the second capacitive section may be determined by a capacitance ratio between the third input capacitive element and the fourth input capacitive element.
[0011] One end of each of the first and third input capacitance elements is commonly connected to a reference signal line, and one end of each of the second and fourth input capacitance elements is commonly connected to a pixel signal line, the first comparator may include a first transistor having a gate commonly connected to the other ends of the first and second input capacitance elements, and the second comparator may include a second transistor having a gate commonly connected to the other ends of the third and fourth input capacitance elements.
[0012] The first comparator may further include a first constant current source connected to one end of the first transistor and output a first output signal from between the first transistor and the first constant current source, and the second comparator may further include a second constant current source connected to one end of the second transistor and output a second output signal from between the second transistor and the second constant current source.
[0013] The first comparator may further include a first constant current source connected to one end of the first transistor, a third transistor having one end connected to the first constant current source, and a first mirror circuit connected to the other ends of the first and third transistors, and output a first output signal from between the third transistor and the first mirror circuit, and the second comparator may further include a second constant current source connected to one end of the second transistor, a fourth transistor having one end connected to the second constant current source, and a second mirror circuit connected to the other ends of the first and fourth transistors, and output a second output signal from between the fourth transistor and the second mirror circuit.
[0014] The first comparator may include a first transistor having a gate connected to the first input capacitive element and one end connected to the second input capacitive element, and the second comparator may include a second transistor having a gate connected to the third input capacitive element and one end connected to the fourth input capacitive element.
[0015] The first and third input capacitance elements may be commonly connected to a reference signal line, and one terminal of each of the first and second transistors may receive a pixel signal via the second and fourth input capacitance elements, respectively.
[0016] The capacitance element may further include a reference signal generating section that supplies the same reference signal to the first and third input capacitance elements.
[0017] The image sensor may further include a signal processing circuit that selects either the first or second output signal in accordance with the illuminance of light irradiating the pixel portion and outputs the selected signal as image data.
[0018] The liquid crystal display device may further include a control unit that changes an exposure time of the pixel unit according to the illuminance of light irradiating the pixel unit.
[0019] The image display device may further include a control unit that controls the slope of the reference signal in accordance with the illuminance of light irradiating the pixel unit.
[0020] The image sensor may further include a control unit that controls the first or second gain in response to the illuminance of light irradiating the pixel unit.
[0021] The image sensor may further include a signal processing circuit that acquires the illuminance of light irradiated onto the pixel unit, and a control unit that sets a first or second gain according to the illuminance, wherein the pixel unit performs imaging with the set first or second gain to generate a pixel signal, and the signal processing circuit converts the pixel signal to generate image data.
[0022] One end of each of the first and third input capacitance elements is commonly connected to a reference signal line, and one end of each of the second and fourth input capacitance elements is commonly connected to a pixel signal line, the first comparator includes a first transistor having a gate connected to the other end of the first input capacitance element and a third transistor having a gate connected to the other end of the second input capacitance element, and the second comparator may include a second transistor having a gate connected to the other end of the third input capacitance element and a fourth transistor having a gate connected to the other end of the fourth input capacitance element. [Brief description of the drawings]
[0023] [Figure 1] 1 is a block diagram showing an example of the arrangement of a solid-state imaging device according to a first embodiment. [Diagram 2]1 is a conceptual diagram showing an example of a solid-state imaging element in which a semiconductor chip of a pixel portion and a semiconductor chip of a processing circuit are stacked. [Diagram 3] FIG. 2 is a circuit diagram showing a configuration example of a pixel provided in a pixel portion. [Figure 4] FIG. 2 is a block diagram showing an example of the configuration of a pixel unit and an ADC group. [Diagram 5] FIG. 4 is a diagram showing an example of the internal configuration of a capacitive section and a comparator. [Figure 6] FIG. 4 is a timing chart showing an example of the operation of the solid-state imaging device according to the first embodiment. [Figure 7] FIG. 2 is a block diagram showing an example of the configuration of a pixel unit and an ADC group. [Figure 8A] FIG. 13 is a diagram showing an example of the configuration of a solid-state imaging element according to a second embodiment. [Figure 8B] FIG. 13 is a diagram showing an example of the configuration of a solid-state imaging element according to a modified example of the second embodiment. [Figure 8C] FIG. 13 is a diagram showing an example of the configuration of a solid-state imaging element according to another modified example of the second embodiment. [Figure 9] FIG. 13 is a diagram showing an example of the configuration of a solid-state imaging element according to a third embodiment. [Figure 10] FIG. 11 is a timing chart showing an example of the operation of the solid-state imaging device according to the third embodiment. [Figure 11] FIG. 13 is a diagram showing an example of the configuration of a solid-state imaging device according to a fourth embodiment. [Figure 12] FIG. 2 is a diagram showing an example of the configuration of a solid-state imaging element according to a first modified example of the first embodiment. [Figure 13] 11 is a table showing the relationship between the exposure time and the input capacitance gain of the solid-state imaging element according to the second modification. [Figure 14] 13 is a timing chart showing an example of the operation of the solid-state imaging element according to the third modification. [Figure 15] 13 is a table showing combinations of reference signals and input capacitance gains according to Modification 3. [Figure 16] FIG. 13 is a block diagram showing an example of the configuration of a solid-state imaging device according to a fifth embodiment. [Figure 17] FIG. 13 is a block diagram showing an example of the configuration of an ADC group according to a fifth embodiment. [Figure 18] FIG. 2 illustrates an example of the configuration of an input capacitor. [Figure 19] FIG. 13 is a flowchart showing the operation of the solid-state imaging device according to the fifth embodiment. [Figure 20] 1 is a block diagram showing a schematic configuration example of a vehicle control system that is an example of a mobile object control system to which the technology according to the present disclosure can be applied. [Figure 21] FIG. 4 is a diagram showing an example of an installation position of an imaging unit. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0024] Hereinafter, specific embodiments to which the present technology is applied will be described in detail with reference to the drawings. The drawings are schematic or conceptual, and the ratios of each part are not necessarily the same as those in reality. In the specification and drawings, elements similar to those described above with respect to the previously mentioned drawings are given the same reference numerals, and detailed descriptions are omitted as appropriate.
[0025] (First embodiment) 1 is a block diagram showing an example of the configuration of a solid-state imaging device 100 according to the first embodiment. The solid-state imaging device 100 includes a pixel unit 101, a timing control circuit 102, a vertical scanning circuit 103, a digital-to-analog converter (DAC) 104, an analog-to-digital converter (ADC) group 105, a horizontal transfer scanning circuit 106, an amplifier circuit 107, and a signal processing circuit 108.
[0026] In the pixel section 101, unit pixels (hereinafter also simply referred to as pixels) including photoelectric conversion elements that photoelectrically convert incident light into an amount of charge corresponding to the amount of light are arranged in a matrix. A specific circuit configuration of the unit pixels will be described later with reference to FIG. 2. In the pixel section 101, pixel drive lines 109 are wired for each row along the left-right direction of the figure (pixel arrangement direction of pixel rows / horizontal direction) for the matrix-like pixel arrangement, and vertical signal lines 110 are wired for each column along the up-down direction of the figure (pixel arrangement direction of pixel columns / vertical direction). One end of the pixel drive lines 109 is connected to an output terminal corresponding to each row of the vertical scanning circuit 103. Note that, although FIG. 1 shows one pixel drive line 109 for each pixel row, two or more pixel drive lines 109 may be provided for each pixel row.
[0027] The timing control circuit 102 includes a timing generator (not shown) that generates various timing signals. The timing control circuit 102 controls the driving of the vertical scanning circuit 103, the DAC 104, the ADC group 105, the horizontal transfer scanning circuit 106, etc., based on various timing signals generated by the timing generator, based on control signals etc. provided from the outside.
[0028] The vertical scanning circuit 103 is composed of a shift register, an address decoder, etc. Although a specific configuration is not shown here, the vertical scanning circuit 103 includes a read scanning system and a sweep scanning system.
[0029] The readout scanning system sequentially performs selective scanning on the unit pixels from which signals are read out, row by row. On the other hand, the sweep scanning system performs sweep scanning on the readout row to sweep out (reset) unnecessary charges from the photoelectric conversion elements of the unit pixels of the readout row, prior to the readout scanning performed by the readout scanning system by the shutter speed time. The sweeping out (resetting) of unnecessary charges by the sweep scanning system performs a so-called electronic shutter operation. Here, the electronic shutter operation refers to an operation of discarding the photoelectric charge of the photoelectric conversion element and starting a new exposure (starting the accumulation of photoelectric charge). The signal read out by the readout operation by the readout scanning system corresponds to the amount of light that has entered since the immediately preceding readout operation or electronic shutter operation. The period from the readout timing of the immediately preceding readout operation or the sweeping timing of the electronic shutter operation to the readout timing of the current readout operation is the accumulation time (exposure time) of the photoelectric charge in the unit pixel.
[0030] The pixel signals VSL output from each unit pixel in a pixel row selected and scanned by the vertical scanning circuit 103 are supplied to the ADC group 105 via a plurality of vertical signal lines 110 corresponding to each column.
[0031] The DAC 104 as a reference signal generating unit generates a reference signal RAMP, which is a signal with a linearly changing ramp waveform, and supplies the reference signal RAMP to the ADC group 105. The DAC 104 is commonly connected to a plurality of comparators 121 via a reference signal line 114, and supplies the same reference signal RAMP to the plurality of comparators 121. The reference signal line 114 transmits the reference signal RAMP to the plurality of comparators 121.
[0032] The ADC group 105 includes a plurality of comparators 121, a plurality of counters 122, and a plurality of latch circuits 123. Although only one ADC group 105 is shown in Fig. 1, the ADC group 105 is actually divided into a plurality of ADC groups 105a and 105b as shown in Fig. 2 or 3. The configurations of the ADC groups 105a and 105b will be described later.
[0033] The comparator 121, the counter 122, and the latch circuit 123 are provided corresponding to the pixel columns of the pixel unit 101, respectively, and constitute an ADC.
[0034] The comparator 121 compares the voltage of a signal obtained by adding together a pixel signal VSL output from each pixel and a reference signal RAMP via a capacitor with a predetermined reference voltage, and supplies an output signal indicating the comparison result to a counter 122.
[0035] The counter 122 converts the analog pixel signal into a digital pixel signal represented by a count value by counting the time until the signal obtained by adding the pixel signal VSL and the reference signal RAMP via a capacitor exceeds a predetermined reference voltage based on the output signal of the comparator 121. The counter 122 supplies the count value to the latch circuit 123.
[0036] The latch circuit 123 holds the count value supplied from the counter 122. Furthermore, the latch circuit 123 performs CDS (Correlated Double Sampling) by calculating the difference between a D-phase count value corresponding to a pixel signal at a signal level and a P-phase count value corresponding to a pixel signal at a reset level.
[0037] The horizontal transfer scanning circuit 106 is composed of a shift register, an address decoder, etc., and sequentially selects and scans circuit portions corresponding to pixel columns of the ADC group 105. Through the selective scanning by the horizontal transfer scanning circuit 106, the digital pixel signals held in the latch circuit 123 are sequentially transferred to the amplifier circuit 107 via the horizontal transfer line 111.
[0038] The amplifier circuit 107 amplifies the digital pixel signal supplied from the latch circuit 123 and supplies the amplified signal to a signal processing circuit 108 .
[0039] The signal processing circuit 108 performs predetermined signal processing on the digital pixel signals supplied from the amplifier circuit 107 to generate two-dimensional image data. For example, the signal processing circuit 108 corrects vertical line defects and point defects, clamps the signal, and performs digital signal processing such as parallel-serial conversion, compression, encoding, addition, averaging, and intermittent operation. The signal processing circuit 108 outputs the generated image data to a downstream device.
[0040] 1 may be configured as a single semiconductor chip as a whole, or may be configured as multiple semiconductor chips. When the solid-state imaging device 100 is configured as multiple semiconductor chips, the pixel section 101 and other processing circuits may be formed as separate semiconductor chips 511 and 512, respectively, and the semiconductor chips 511 and 512 may be stacked.
[0041] For example, Fig. 2 is a conceptual diagram showing an example of a solid-state imaging element 100 in which a semiconductor chip 511 of a pixel section 101 and a semiconductor chip 512 of a processing circuit are stacked. As shown in Fig. 2, the solid-state imaging element 100 is composed of two stacked semiconductor chips 511 and 512. The number of stacked semiconductor chips may be three or more.
[0042] The semiconductor chip 511 includes a pixel unit 101 formed on a semiconductor substrate. The semiconductor chip 512 includes ADC groups 105a and 105b, a logic circuit 516, and a peripheral circuit 517 formed on another semiconductor substrate. The ADC group 105 is divided into a plurality of parts (105a, 105b), and each part is set to have a different gain, for example. The logic circuit 516 includes a timing control circuit 102, a vertical scanning circuit 103, a DAC 104, a horizontal transfer scanning circuit 106, and the like. The peripheral circuit 517 includes a processing circuit 108, and the like.
[0043] Each pixel of the pixel section 101 of the semiconductor chip 511 and elements of the processing circuits (105a, 105b, 516, 517) of the semiconductor chip 512 may be electrically connected using a through electrode such as a TSV (Through Silicon Via) provided in the via regions 513, 514. The ADC groups 105a, 105b can transmit and receive signals to and from the pixel section 101 via the TSV. In addition, both semiconductor chips may be bonded together so that the wiring of the semiconductor chip 511 and the wiring of the semiconductor chip 512 are in contact with each other (Cu-Cu bonding). Furthermore, although not shown, the pixel section 101 and a part of the processing circuits (105a, 105b, 516, 517) may be configured as one semiconductor chip 511, and the other components may be configured as another semiconductor chip 512.
[0044] 3 is a circuit diagram showing an example of the configuration of a pixel 150 provided in the pixel unit 101. The pixel 150 includes, for example, a photodiode 151 as a photoelectric conversion element, and includes four transistors, a transfer transistor 152, an amplification transistor 154, a selection transistor 155, and a reset transistor 156, as active elements for the photodiode 151.
[0045] The photodiode 151 photoelectrically converts incident light into an amount of charge (electrons in this case) corresponding to the amount of light.
[0046] The transfer transistor 152 is connected between the photodiode 151 and an FD (floating diffusion) 153. When the transfer transistor 152 is turned on by a drive signal TX supplied from the vertical scanning circuit 103, the transfer transistor 152 transfers the charge accumulated in the photodiode 151 to the FD 153.
[0047] A gate of an amplifying transistor 154 is connected to the FD 153. The amplifying transistor 154 is connected to a vertical signal line 110 via a selecting transistor 155, and forms a source follower together with a constant current source 157 outside the pixel unit 101. When the selecting transistor 155 is turned on by a driving signal SEL supplied from the vertical scanning circuit 103, the amplifying transistor 154 amplifies the potential of the FD 153, and outputs a pixel signal indicating a voltage according to the potential to the vertical signal line 110. Then, the pixel signal output from each pixel 150 is supplied to each comparator 121 of the ADC group 105 via the vertical signal line 110.
[0048] The reset transistor 156 is connected between a power supply VDD and the FD 153. When the reset transistor 156 is turned on by a drive signal RST supplied from the vertical scanning circuit 103, the potential of the FD 153 is reset to the potential of the power supply VDD.
[0049] 4 is a block diagram showing an example of the configuration of the pixel unit 101 and the ADC groups 105a and 105b. Each pixel column of a plurality of pixels 150 included in the pixel unit 101 is connected to both of the ADC groups 105a and 105b via a vertical signal line 110. The vertical signal line 110 is provided for each pixel column consisting of a plurality of pixels 150, and transmits the same pixel signal VSL from the pixels 150 selected in the pixel column. Note that while FIG. 4 shows only one pixel 150 with respect to the vertical signal line 110, the vertical signal line 110 is shared by a plurality of pixels 150 in the pixel column as shown in FIG. 5.
[0050] The ADC group 105a includes a plurality of capacitance units 120a and a plurality of comparators 121a provided corresponding to the respective pixel columns. The capacitance units 120a are connected to the vertical signal lines 110, and transmit pixel signals VSL from the pixels 150 to the comparators 121a. At this time, the capacitance of the capacitance units 120a is changeable to set the input capacitance gain of the pixel signal VSL. The comparators 121a receive the pixel signals VSL via the capacitance units 120a, and output the result of comparing the pixel signals VSL with a reference signal RAMP to the counter 122 in FIG. 1.
[0051] The ADC group 105b includes a plurality of capacitance units 120b and a plurality of comparators 121b provided corresponding to each pixel column. The capacitance units 120b are connected to the vertical signal lines 110, and transmit pixel signals VSL from the pixels 150 to the comparators 121b. At this time, the capacitance of the capacitance units 120b is changeable to set the input capacitance gain of the pixel signal VSL. The comparator 121b receives the pixel signal VSL via the capacitance units 120b, and outputs a result of comparing the pixel signal VSL with a reference signal RAMP to the counter 122 in FIG. 1.
[0052] The capacitive units 120a and 120b have different input capacitance gains. For example, the capacitive unit 120a has a relatively low input capacitance gain, and the capacitive unit 120b has a relatively high input capacitance gain. The input capacitance gain is a transfer ratio of the pixel signal VSL to the reference signal RAMP. When the input capacitance gain is high, the transfer ratio of the pixel signal VSL is large, and the solid-state imaging device 100 can accurately detect even low-illuminance irradiation light. When the input capacitance gain is low, the transfer ratio of the pixel signal VSL is small, and the solid-state imaging device 100 can detect high-illuminance irradiation light in a short time. The input capacitance gain can be controlled by changing the capacitance ratio of the capacitive element that transfers the pixel signal VSL and the capacitive element that transfers the reference signal RAMP.
[0053] The capacitive section 120a has a relatively low input capacitance gain and is therefore used to detect irradiated light with a high illuminance, whereas the capacitive section 120b has a relatively high input capacitance gain and is therefore used to detect irradiated light with a low illuminance.
[0054] In this manner, each pixel 150 is connected via the corresponding vertical signal line 110 to a plurality of ADC groups 105a and 105b having different input capacitance gains.
[0055] FIG. 5 is a diagram showing an example of the internal configuration of the capacitive sections 120a and 120b and the comparators 121a and 121b.
[0056] The capacitance unit 120a as a first capacitance unit is provided between the vertical signal line 110 or the reference signal line 114 and the comparator 121a, and is set to a low gain as a first gain. The capacitance unit 120a includes an input capacitance element Crmpa and an input capacitance element Cvsla. The input capacitance element Crmpa as a first input capacitance element is provided between the reference signal line 114 and the gate of the transistor Tp1a of the comparator 121a. The input capacitance element Cvsla as a second input capacitance element is provided between the vertical signal line 110 and the comparator 121a.
[0057] That is, one end of each of the input capacitance elements Crmpa and Cvsla is connected to the vertical signal line 110 and the reference signal line 114. The other ends of the input capacitance elements Crmpa and Cvsla are commonly connected to the gate of the transistor Tp1a.
[0058] The capacitance unit 120b as the second capacitance unit is provided between the vertical signal line 110 or the reference signal line 114 and the comparator 121b, and is set to a high gain as a second gain. The second gain is higher than the first gain. The capacitance unit 120b includes an input capacitance element Crmpb and an input capacitance element Cvslb. The input capacitance element Crmpb as the third input capacitance element is provided between the reference signal line 114 and the gate of the transistor Tp1b of the comparator 121b. The input capacitance element Cvslb as the fourth input capacitance element is provided between the vertical signal line 110 and the comparator 121b.
[0059] That is, one end of each of the input capacitance elements Crmpb and Cvslb is connected to the vertical signal line 110 and the reference signal line 114. The other ends of the input capacitance elements Crmpb and Cvslb are commonly connected to the gate of the transistor Tp1b.
[0060] Furthermore, the capacitive units 120a and 120b share the corresponding reference signal line 114 and also share the corresponding vertical signal line 110. Therefore, one end of the input capacitive elements Crmpa and Crmpb is commonly connected to the reference signal line 114. One end of the input capacitive elements Cvsla and Cvslb is commonly connected to the vertical signal line 110 via the vertical signal line 110.
[0061] In this embodiment, the capacitances of the input capacitance elements Crmpa and Crmpb are almost equal to each other, but the capacitances of the input capacitance elements Cvsla and Cvslb are different from each other. Therefore, the capacitance ratio between the input capacitance element Crmpa and the input capacitance element Cvsla (the input capacitance gain Ga of the capacitance section 120a) is different from the capacitance ratio between the input capacitance element Crmpb and the input capacitance element Cvslb (the input capacitance gain Gb of the capacitance section 120b). The input capacitance gain Ga of the capacitance section 120a is determined by the capacitance ratio of the input capacitance element Cvsla to the input capacitance element Crmpa (for example, Cvsla / Cvsla+Crmpa). The input capacitance gain Gb of the capacitance section 120b is determined by the capacitance ratio of the input capacitance element Cvslb to the input capacitance element Crmpb (for example, Cvslb / Cvslb+Crmpb).
[0062] In this embodiment, for example, since the input capacitance element Cvslb is larger than the input capacitance element Cvsla, the input capacitance gain Gb of the capacitance section 120b is set to be larger than the input capacitance gain Ga of the capacitance section 120a.
[0063] The input capacitance elements Crmpa, Crmpb, Cvsla, and Cvslb are variable capacitance elements. For example, the input capacitance elements Crmpa, Crmpb, Cvsla, and Cvslb are adjusted by changing the number of elements of the same capacitance connected in parallel or series by trimming or a switch (not shown), etc. The trimming or switching of the input capacitance elements Crmpa, Crmpb, Cvsla, and Cvslb may be performed at the time of manufacturing or shipping the solid-state imaging device 100. Alternatively, as will be described with reference to FIG. 11, the switching of the input capacitance elements Crmpa, Crmpb, Cvsla, and Cvslb may be performed by switching the switches SWc1 and SWc2 based on the illuminance of the irradiated light.
[0064] The comparator 121a as a first comparator is connected to the capacitance unit 120a, and is a single-type amplifier that outputs an output signal OUTa according to the pixel signal VSL based on (by amplifying) the voltage difference between the pixel signal VSL and the reference signal RAMP.
[0065] The comparator 121a includes an n-type transistor Tn1a, a p-type transistor Tp1a, and an n-type transistor Tn2a. The transistors Tn1a, Tp1a, and Tn2a are connected in series in this order between a power supply Vdd and a ground GND.
[0066] The drain of the transistor Tn1a is connected to the power supply Vdd, and the source of the transistor Tp1a is connected to the source of the transistor Tp1a. The transistor Tn1a functions as an LDO (Low Dropout) linear regulator.
[0067] As described above, the gate of the transistor Tp1a serving as the first transistor is commonly connected to the other end of the input capacitance elements Crmpa and Cvsla. The source of the transistor Tp1a is connected to the source of the transistor Tn1a, and the drain of the transistor Tp1a is connected to the output terminal and the drain of the transistor Tn2a. When the sum signal of the pixel signal VSL from the capacitance unit 120a and the reference signal RAMP from the DAC 104 exceeds the reference voltage, the transistor Tp1a changes from a conductive state to a non-conductive state, thereby inverting the level of the output signal OUTa. That is, the transistor Tp1a functions as an amplifier that amplifies and detects the level of the pixel signal VSL.
[0068] The transistor Tn2a functions as a constant current source for supplying a constant current to the transistor Tp1a.
[0069] The AZ switch SW1a is connected between the gate of the transistor Tp1a and the output terminal Touta, and performs an auto-zero operation by equalizing the potential between the gate of the transistor Tp1a and the output terminal Touta before detecting the pixel signal VSL.
[0070] With this configuration, the comparator 121a outputs an output signal OUTa as a first output signal from an output section between the transistor Tp1a and the transistor Tn2a.
[0071] The comparator 121b serving as a second comparator is connected to the capacitance section 120b, and outputs an output signal OUT2 corresponding to the pixel signal VSL based on the voltage difference between the pixel signal VSL and the reference signal RAMP.
[0072] The comparator 121b includes an n-type transistor Tn1b, a p-type transistor Tp1b, and an n-type transistor Tn2b. The transistors Tn1b, Tp1b, and Tn2b are connected in series in this order between a power supply Vdd and a ground voltage GND.
[0073] The drain of the transistor Tn1b is connected to the power supply Vdd, and the source of the transistor Tn1b is connected to the source of the transistor Tp1b. The transistor Tn1b functions as an LDO linear regulator, similar to the transistor Tn1a.
[0074] As described above, the gate of the transistor Tp1b as the second transistor is commonly connected to the other end of the input capacitance elements Crmpb and Cvslb. The source of the transistor Tp1b is connected to the source of the transistor Tn1b, and the drain of the transistor Tp1b is connected to the output terminal and the drain of the transistor Tn2b. When the sum signal of the pixel signal VSL from the capacitance unit 120b and the reference signal RAMP from the DAC 104 exceeds the reference voltage, the transistor Tp1b changes from a conductive state to a non-conductive state, and inverts the level of the output signal OUTb. That is, the transistor Tp1b functions as an amplifier that amplifies and detects the level of the pixel signal VSL.
[0075] The transistor Tn2b functions as a constant current source for supplying a constant current to the transistor Tp1b.
[0076] The AZ switch SW1b is connected between the gate of the transistor Tp1b and the output terminal Toutb, and performs an auto-zero operation by equalizing the potential between the gate of the transistor Tp1a and the output terminal Toutb before detection of the pixel signal VSL.
[0077] With this configuration, the comparator 121b outputs an output signal OUTb as a second output signal from the output section between the transistor Tp1b and the transistor Tn2b.
[0078] The current sources CS1a and CS1b are connected to the vertical signal line 110 and configured to supply a constant current to the vertical signal line 110.
[0079] The configuration of the comparator 121b is the same as that of the comparator 121a. That is, the transistors Tn1a and Tn1b have the same configuration, the transistors Tp1a and Tp1b have the same configuration, and the transistors Tn2a and Tn2b have the same configuration. As a result, the gains Ga and Gb of the ADC groups 105a and 105b are almost determined by the difference between the capacitance ratio of the input capacitance element Cvsla to the input capacitance element Crmpa and the capacitance ratio of the input capacitance element Cvslb to the input capacitance element Crmpb. Therefore, the ADC group 105a outputs the comparison result between the pixel signal VSL and the reference signal RAMP as the output signal OUTa with a low gain. The ADC group 105b outputs the comparison result between the pixel signal VSL and the reference signal RAMP as the output signal OUTb with a high gain. As a result, the solid-state imaging device 100 can detect irradiation light in a wide dynamic range (HDR (High Dynamic Range)) from low illuminance to high illuminance. Furthermore, by making the comparators 121a and 121b have the same configuration, the comparators 121a and 121b can be formed simultaneously in the same process, thereby making it possible to keep the manufacturing cost low.
[0080] Next, the operation of the solid-state imaging device 100 according to this embodiment will be described.
[0081] 6 is a timing diagram showing an example of the operation of the solid-state imaging device 100 according to the first embodiment. The horizontal axis indicates time. The vertical axis indicates the drive signals of the AZ switches SW1a and SW1b, the pixel signal VSL, the reference signal RAMP, the gate voltages of the transistors Tp1a and Tp1b, and the voltage levels (signal levels) of the output signals OUTa and OUTb. Note that during signal detection, the transistors Tn1a and Tn1b are assumed to be always on. Also, the transistors Tn2a and Tn2b are assumed to pass a constant current through the transistors Tp1a and Tp1b.
[0082] At time t1, the FD 153 of the pixel 150 to be read out is reset, and the pixel signal VSL is set to the reset level. At this time, the reference signal RAMP is set to a predetermined reset level.
[0083] At time t2, the drive signals of the AZ switches SW1a and SW1b are set to a high level, and the comparators 121a and 121b perform an auto-zero operation. Specifically, the AZ switch SW1a is turned on, the gate of the transistor Tp1a is connected to the output section Touta, and the input and output of the comparator 121a are short-circuited. As a result, the gate voltage of the transistor Tp1a and the voltage of the output signal OUTa converge to a voltage close to the middle between the high level and the low level of the output signal OUTa. This converged voltage becomes the reference voltage of the comparator 121a. Therefore, after that, when the AZ switch SW1a is turned off, if the gate voltage of the transistor Tp1a (the input voltage of the comparator 121a) rises above the reference voltage, the voltage of the output signal OUTa falls and becomes a low level. On the other hand, if the gate voltage of the transistor Tp1a (the input voltage of the comparator 121a) falls below the reference voltage, the voltage of the output signal OUTa rises and becomes a high level.
[0084] The AZ switch SW1b also performs an auto-zero operation for the comparator 121b in the same manner as the AZ switch SW1a. That is, the AZ switch SW1b is turned on, the gate of the transistor Tp1b is connected to the output section Toutb, and the input and output of the comparator 121b are short-circuited. As a result, the gate voltage of the transistor Tp1b and the voltage of the output signal OUTb converge to a voltage close to the middle between the high level and the low level of the output signal OUTb. This converged voltage becomes the reference voltage of the comparator 121b. Therefore, after this, when the AZ switch SW1b is turned off, if the gate voltage of the transistor Tp1b (input voltage of the comparator 121b) rises above the reference voltage, the voltage of the output signal OUTb drops to a low level. On the other hand, if the gate voltage of the transistor Tp1b (input voltage of the comparator 121b) falls below the reference voltage, the voltage of the output signal OUTb rises to a high level.
[0085] At time t3, the drive signals of the AZ switches SW1a and SW1b are set to a low level, the AZ switches SW1a and SW1b are turned off, and the auto-zero operation of the comparators 121a and 121b ends. The voltages of the transistors Tp1a and Tp1b and the voltages of the output signals OUTa and OUTb are maintained at the reference voltages. Since the comparators 121a and 121b have the same configuration, the reference voltages of the comparators 121a and 121b are almost the same.
[0086] At time t4, the voltage of the reference signal RAMP drops from the reset level by a predetermined value, causing the gate voltages of the transistors Tp1a and Tp1b to drop below the reference voltage, and the output signals OUTa and OUTb to go high.
[0087] At time t5, the voltage level of the reference signal RAMP increases linearly. In response to this, the gate voltages of the transistors Tp1a and Tp1b also increase linearly. Also, the counter 122 in FIG. 1 starts counting.
[0088] At time t5-1, when the gate voltages of the transistors Tp1a and Tp1b exceed the reference voltage, the voltages of the output signals OUTa and OUTb are inverted to low level. The count value of the counter 122 when the output signals OUTa and OUTb are inverted to low level is held in the latch circuit 123 of Fig. 1 as the value of the P-phase (reset level) pixel signal VSL. The latch circuit 123 latches both the output signals OUTa and OUTb.
[0089] At time t6, the voltage of the reference signal RAMP is set to the reset voltage again, causing the gate voltages of the transistors Tp1a and Tp1b to return to the reference voltage, and the output signals OUTa and OUTb to become approximately equal to the reference voltage.
[0090] At time t7, the transfer transistor 152 of the pixel 150 is turned on, and the charge accumulated in the photodiode 151 during the exposure period is transferred to the FD 153. This causes the pixel signal VSL to go to a signal level, and the gate voltages of the transistors Tp1a and Tp1b drop from the reference voltage by a value corresponding to the signal level. As a result, the output signals OUTa and OUTb go to a high level. However, if the signal level of the pixel signal VSL is small, the output signals OUTa and OUTb are held at a value close to the reference voltage.
[0091] At time t8, similarly to time t4, the voltage of the reference signal RAMP is lowered from the reset level by a predetermined value, causing the gate voltages of the transistors Tp1a and Tp1b to further drop from the signal level.
[0092] At time t9, similarly to time t5, the voltage level of the reference signal RAMP increases linearly. Accordingly, the gate voltages of the transistors Tp1a and Tp1b also increase linearly. In addition, the counter 122 starts counting.
[0093] At times t9-1 to t9-3, when the gate voltages of the transistors Tp1a and Tp1b exceed the reference voltage, the output signals OUTa and OUTb are inverted to low level. For example, when the illuminance of the irradiated light is weak and the pixel signal VSL is small, as shown by the line L1, the level of the gate voltages of the transistors Tp1a and Tp1b does not drop much in the pixel signal VSL. In this case, at a relatively early time t9-1, the gate voltages of the transistors Tp1a and Tp1b exceed the reference voltage, and the output signals OUTa and OUTb are inverted to low level. When the illuminance of the irradiated light is medium and the pixel signal VSL is medium, as shown by the line L2, at t9-2, the gate voltages of the transistors Tp1a and Tp1b exceed the reference voltage, and the output signals OUTa and OUTb are inverted to low level. When the illuminance of the irradiated light is strong and the pixel signal VSL is high, as shown by line L3, at a relatively late time t9-3, the gate voltages of the transistors Tp1a and Tp1b exceed the reference voltage, and the output signals OUTa and OUTb are inverted to a low level. Thus, the period from when the reference signal RAMP starts to increase to when the output signals OUTa and OUTb are inverted differs depending on the illuminance of the irradiated light.
[0094] The count value of the counter 122 when the output signals OUTa and OUTb are inverted to a low level is held in the latch circuit 123 of FIG. 1 as the value of the D-phase (signal level) pixel signal VSL. The latch circuit 123 latches both the output signals OUTa and OUTb. The latch circuit 123 performs CDS by taking the difference between the D-phase pixel signal VSL and the P-phase pixel signal VSL read out between time t5 and time t6. In this manner, AD conversion of the pixel signal VSL is performed. The AD conversion is performed in each of the ADC groups 105a and 105b, and is performed on the pixel signal VSL detected with different input capacitance gains. The digital image data from the ADC group 105a and the digital image data from the ADC group 105b are each transmitted to the signal processing circuit 108.
[0095] Since the period from when the reference signal RAMP starts to increase to when the output signals OUTa and OUTb invert varies depending on the illuminance of the irradiated light, the digital image data from the ADC groups 105a and 105b also have values based on the illuminance of the irradiated light.
[0096] Thereafter, the signal processing circuit 108 selects or generates a pixel signal using either or both of the output signals OUTa and OUTb to generate image data. At this time, the signal processing circuit 108 may select the output signal OUTa or OUTb according to the illuminance of the irradiated light.
[0097] At time t10, similar to time t6, the voltage of the reference signal RAMP is set to the reset voltage. This causes the gate voltages of the transistors Tp1a and Tp1b to return to the reference voltage, and the output signal OUT1 becomes approximately equal to the reference voltage. After that, from time t11 onwards, the same operations as those from time t1 to t10 are repeated.
[0098] According to this embodiment, the solid-state imaging device 100 is divided into a plurality of ADC groups 105a and 105b, each of which corresponds to a pixel column and has a different gain. The gains of the ADC groups 105a and 105b are set by the input capacitance gains Ga and Gb of the capacitance units 120a and 120b. This allows the signal processing circuit 108 to select or generate a pixel signal using one or both of the output signals OUTa and OUTb generated by detecting the pixel signal at a plurality of gains, and generate image data. At this time, the signal processing circuit 108 may select the output signals OUTa and OUTb according to the illuminance (light intensity) of the irradiated light. For example, when the illuminance of the irradiated light is relatively strong, the signal processing circuit 108 selects the output signal OUTa detected by the ADC group 105a at a low gain to generate image data. When the illuminance of the irradiated light is relatively weak, the signal processing circuit 108 selects the output signal OUTb detected by the ADC group 105b at a high gain to generate image data. As a result, the solid-state imaging element 100 can capture images with high sensitivity (fine gradation) even under low-illuminance illumination light, and can capture images in a short time (low power consumption) without saturation even under high-illuminance illumination light. That is, the solid-state imaging element 100 according to this embodiment can capture images with a wide dynamic range (HDR) according to the illuminance of the illumination light.
[0099] In addition, as shown in FIG. 2, in the solid-state imaging device 100 according to the present embodiment, the ADC group corresponding to each pixel column is divided into a plurality of ADC groups 105a and 105b, which are connected in parallel. The ADC groups 105a and 105b are provided on both sides of the logic circuit 516 and the peripheral circuit 517, and are spaced apart from each other. If a plurality of ADCs with different gains are adjacent to each other, the output signals from the plurality of ADCs may affect each other due to the proximity effect. In contrast, the ADC groups 105a and 105b according to the present embodiment are spaced apart from each other, so that they can be prevented from affecting each other even if they have different gains. This enables the solid-state imaging device 100 to generate accurate image data.
[0100] According to this embodiment, the gains of the ADC groups 105a and 105b are set by the capacitance ratio between the input capacitance elements Crmpa and Cvsla of the capacitance unit 120a and the capacitance ratio between the input capacitance elements Crmpb and Cvslb of the capacitance unit 120b. Therefore, the pixel signal VSL and the reference signal RAMP may be the same or common to the ADC groups 105a and 105b. For example, as shown in FIG. 7, the DAC 104 is provided in common to the ADC groups 105a and 105b, and the same reference signal RAMP may be supplied to the ADC groups 105a and 105b via the reference signal line 114. Even if a plurality of ADC groups 105a and 105b are provided, the DAC 104 can be commonized, so that the overall size of the solid-state imaging device 100 can be kept small. Of course, if it is not necessary to consider the size of the solid-state imaging device 100, the DAC 104 may be provided corresponding to each of the plurality of ADC groups 105a and 105b.
[0101] In this embodiment, the comparators 121a and 121b are configured with single amplifiers. Therefore, compared with the case where a differential amplifier is used as in the second embodiment, the solid-state imaging device 100 according to the first embodiment can reduce current consumption by almost half, thereby reducing power consumption.
[0102] Furthermore, the input voltage of the comparators 121a and 121b is a sum signal of the pixel signal VSL and the reference signal RAMP. When the pixel signal VSL and the reference signal RAMP have opposite polarities, the input voltage of the comparators 121a and 121b is a differential voltage between the pixel signal VSL and the reference signal RAMP, and the amplitude is reduced. This makes it possible to reduce the voltage fluctuation of the comparators 121a and 121b, and to reduce the voltage of the power supply Vdd. As a result, the power consumption of the solid-state imaging device 100 can be reduced.
[0103] Second embodiment 8A is a diagram showing an example of the configuration of a solid-state imaging device 100 according to the second embodiment. In the second embodiment, the configurations of the comparators 121a and 121b are different from those of the first embodiment. The other configurations including the capacitance units 120a and 120b may be similar to the corresponding configurations of the first embodiment.
[0104] The comparator 121a is connected to the capacitance unit 120a, and is a differential circuit that outputs an output signal OUTa according to the pixel signal VSL based on the voltage difference between the pixel signal VSL and the reference signal RAMP.
[0105] The comparator 121a includes p-type transistors Tp2a to Tp4a, a current mirror circuit CMa, AZ switches SW2a and SW3a, and a capacitive element C1a.
[0106] The source of the transistor Tp2a is connected to the power supply Vdd, and the drain of the transistor Tp2a is commonly connected to the sources of the transistors Tp3a and Tp4a.
[0107] The gate of the transistor Tp3a serving as a first transistor is commonly connected to the other end of the input capacitance elements Crmpa and Cvsla The source of the transistor Tp3a is connected to the drain of the transistor Tp2a, and the drain of the transistor Tp3a is connected to the current mirror circuit CMa.
[0108] The gate of the third transistor Tp4a is connected to the ground GND via the capacitance element C1a. The source of the transistor Tp4a is connected to the drain of the transistor Tp2a in common with the source of the transistor Tp3a. The drain of the transistor Tp4a is connected to the current mirror circuit CMa and the output unit Touta.
[0109] The current mirror circuit CMa as a first mirror circuit is connected between the drains of the transistors Tp3a and Tp4a and the ground GND, and is configured to pass approximately equal currents through the transistors Tp3a and Tp4a. More specifically, the current mirror circuit CMa includes an n-type transistor Tn3a connected between the transistor Tp3a and the ground GND, and an n-type transistor Tn4a connected between the transistor Tp4a and the ground GND. The gates of the transistors Tn3a and Tn4a are commonly connected to the drain of the transistor Tn3a.
[0110] The AZ switch SW2a is connected between the gate and drain of the transistor Tp3a, and performs an auto-zero operation by equalizing the potential between the gate and drain of the transistor Tp3a before detection of the pixel signal VSL.
[0111] The AZ switch SW3a is connected between the gate and drain of the transistor Tp4a, and performs an auto-zero operation by equalizing the potential between the gate and drain of the transistor Tp4a before detection of the pixel signal VSL.
[0112] The transistor Tp3a goes from a conductive state to a non-conductive state when the voltage level of the sum signal of the pixel signal VSL and the reference signal RAMP exceeds the reference voltage. The current mirror circuit CMa passes a current obtained by multiplying the current flowing through the transistor Tp3a by a predetermined mirror ratio to the transistor Tp4a. The transistor Tp4a generates the voltage level of the output signal OUTa according to the current flowing through the transistor Tp3a. When the transistor Tp3a goes from a conductive state to a non-conductive state, the transistor Tp4a passes a predetermined current in the same manner as the transistor Tn3a, and thus inverts the output signal OUTa from a low level to a high level. That is, the comparator 121a inverts the level of the output signal OUTa when the voltage level of the sum signal of the pixel signal VSL and the reference signal RAMP exceeds the reference voltage, similar to that of the first embodiment.
[0113] The comparator 121b is connected to the capacitance unit 120b, and is a differential circuit that outputs an output signal OUTb corresponding to the pixel signal VSL based on the voltage difference between the pixel signal VSL and the reference signal RAMP.
[0114] The comparator 121b includes p-type transistors Tp2b to Tp4b, a current mirror circuit CMb, AZ switches SW1b and SW2b, and a capacitive element C1b.
[0115] The source of the transistor Tp2b is connected to the power supply Vdd, and the drain of the transistor Tp2b is commonly connected to the sources of the transistors Tp3b and Tp4b.
[0116] The gate of the transistor Tp3b serving as a second transistor is commonly connected to the other end of the input capacitance elements Crmpb and Cvslb. The source of the transistor Tp3b is connected to the drain of the transistor Tp2b, and the drain of the transistor Tp3b is connected to the current mirror circuit CMb.
[0117] The gate of the fourth transistor Tp4b is connected to the ground GND via the capacitance element C1b. The source of the transistor Tp4b is connected to the drain of the transistor Tp2b in common with the source of the transistor Tp3b. The drain of the transistor Tp4b is connected to the current mirror circuit CMb and the output unit Toutb.
[0118] The current mirror circuit CMb as the second mirror circuit is connected between the drains of the transistors Tp3b and Tp4b and the ground GND, and is configured to pass approximately equal currents through the transistors Tp3b and Tp4b. More specifically, the current mirror circuit CMb includes an n-type transistor Tn3b connected between the transistor Tp3b and the ground GND, and an n-type transistor Tn4b connected between the transistor Tp4b and the ground GND. The gates of the transistors Tn3b and Tn4b are commonly connected to the drain of the transistor Tn3b.
[0119] The AZ switch SW2b is connected between the gate and drain of the transistor Tp3b, and performs an auto-zero operation by equalizing the potential between the gate and drain of the transistor Tp3b before detection of the pixel signal VSL.
[0120] The AZ switch SW3b is connected between the gate and drain of the transistor Tp4b, and performs an auto-zero operation by equalizing the potential between the gate and drain of the transistor Tp4b before detection of the pixel signal VSL.
[0121] The transistor Tp3b goes from a conductive state to a non-conductive state when the voltage level of the sum signal of the pixel signal VSL and the reference signal RAMP exceeds the reference voltage. The current mirror circuit CMb passes a current obtained by multiplying the current flowing through the transistor Tp3b by a predetermined mirror ratio to the transistor Tp4b. The transistor Tp4b generates the voltage level of the output signal OUTb according to the current flowing through the transistor Tp3b. As a result, when the transistor Tp3b goes from a conductive state to a non-conductive state, the transistor Tp4b passes a predetermined current in the same manner as the transistor Tn3b, thereby inverting the output signal OUTb from a low level to a high level. That is, the comparator 121b inverts the level of the output signal OUTb when the voltage level of the sum signal of the pixel signal VSL and the reference signal RAMP exceeds the reference voltage, similar to that of the first embodiment.
[0122] Other configurations and operations of the second embodiment may be the same as the corresponding configurations and operations of the first embodiment. Therefore, although the second embodiment consumes more power than the first embodiment, it can obtain the other effects of the first embodiment.
[0123] (Modification) 8B is a diagram showing an example of the configuration of a solid-state imaging device 100 according to a modification of the second embodiment. In this modification, the comparators 121a and 121b function as a differential circuit between the pixel signal VSL and the reference signal RAMP. The other end of the input capacitance element Cvsla is not connected to the gate of the transistor Tp3a, but is connected to the gate of the transistor Tp4a. The other end of the input capacitance element Cvslb is not connected to the gate of the transistor Tp3b, but is connected to the gate of the transistor Tp4b.
[0124] The input capacitance elements Cgnda and Cgndb are connected between the gates of the transistors Tp3a and Tp3b and the ground GND, respectively. The input capacitance elements Cgnda and Cgndb are variable capacitance elements. They may be variable capacitance elements similar to the input capacitance elements Crmpa and Crmp. In this modification, the input capacitance element gains Ga and Gb are set by making the capacitances of the input capacitance elements Cgnda and Cgndb different from each other.
[0125] The comparator 121a amplifies the difference between the pixel signal VSL and the reference signal RAMP and outputs it as an output signal OUTa. The comparator 121b amplifies the difference between the pixel signal VSL and the reference signal RAMP and outputs it as an output signal OUTb. At this time, the input capacitance gain Ga of the capacitance unit 120a is determined by the capacitance ratio of the input capacitance elements Crmpa and Cgnda. The input capacitance gain Gb of the capacitance unit 120b is determined by the capacitance ratio of the input capacitance elements Crmpb and Cgndb.
[0126] The operation of this modification may be the same as that of the second embodiment, and therefore the modification can achieve the same effects as the second embodiment.
[0127] (Modification) FIG. 8C is a diagram showing a configuration example of the solid-state imaging device 100 according to another modification of the second embodiment. In this modification, the input capacitance elements Cgnda and Cgndb are connected between the gates of the transistors Tp4a and Tp4b and the ground GND, respectively. In this modification, the input capacitance element gains Ga and Gb are set by making the capacitances of the input capacitance elements Cgnda and Cgndb different from each other. The input capacitance gain Ga of the capacitance unit 120a is determined by the capacitance ratio of the input capacitance elements Cvsla and Cgnda. The input capacitance gain Gb of the capacitance unit 120b is determined by the capacitance ratio of the input capacitance elements Cvslb and Cgndb. The other configurations of this modification may be the same as the configuration of the modification of FIG. 8B. The operation of this modification may be the same as that of the second embodiment. Therefore, this modification can also obtain the same effects as the second embodiment.
[0128] Third embodiment 9 is a diagram showing an example of the configuration of a solid-state imaging device 100 according to the third embodiment. In the third embodiment, the configurations of the comparators 121a and 121b and the vertical signal line 110 are different from those in the first embodiment. Other configurations including the capacitance units 120a and 120b may be similar to the corresponding configurations in the first embodiment.
[0129] In the third embodiment, a constant current source CS1a is connected to each vertical signal line 110. The constant current source CS1a supplies a predetermined constant current to the vertical signal line 110 when detecting a pixel signal, and generates a pixel signal VSL in the vertical signal line 110.
[0130] The comparator 121a includes an n-type transistor Tn5a, a p-type transistor Tp5a, a constant current source CS2a, and AZ switches SW4a and SW5a.
[0131] The gate of the transistor Tn5a is connected to the other end of the input capacitance element Cvsla. The drain of the transistor Tn5a is connected to the power supply Vdd, and the source of the transistor Tn5a is connected to the source of the transistor Tp5a. The transistor Tn5a generates a signal of a voltage level corresponding to the pixel signal VSL and transmits it to the source of the transistor Tp5a.
[0132] The gate of the transistor Tp5a as the first transistor is connected to the other end of the input capacitance element Crmpa. The source of the transistor Tp5a is connected to the source of the transistor Tn5a, and the drain of the transistor Tp5a is connected to the constant current source CS2a and the output section Touta. The transistor Tp5a is turned on based on the voltage difference Vgs between the source voltage and the gate voltage.
[0133] For example, in the third embodiment, when the pixel signal VSL is detected, the voltage level of the reference signal RAMP is linearly decreased from a level higher than the pixel signal VSL. As a result, when the reference signal RAMP falls below the pixel signal VSL, the transistor Tp5a changes from a non-conductive state to a conductive state. The constant current source CS2a passes a constant current through the transistors Tn5a and Tp5a. Therefore, when the transistor Tp5a is in a non-conductive state, the output signal OUTa is at a low level, and when the transistor Tp5a is in a conductive state, the output signal OUTa is at a high level. That is, when the reference signal RAMP falls below the pixel signal VSL, the output signal OUTa is inverted from a low level to a high level. In this way, in the third embodiment, the transistor Tp5a can generate the output signal OUTa by amplifying the difference voltage between the pixel signal VSL and the reference signal RAMP.
[0134] The input capacitance elements Cgnda and Cgndb are connected between the gates of the transistors Tp5a and Tp5b and the ground GND, respectively. The input capacitance elements Cgnda and Cgndb are variable capacitance elements. They may be variable capacitance elements similar to the input capacitance elements Crmpa and Crmp. In the third embodiment, the input capacitance element gains Ga and Gb are set by making the capacitances of the input capacitance elements Cgnda and Cgndb different from each other.
[0135] The AZ switch SW4a is connected between the gate and drain of the transistor Tn5a, and performs an auto-zero operation by equalizing the potential between the gate and drain of the transistor Tn5a before detection of the pixel signal VSL.
[0136] The AZ switch SW5a is connected between the gate and drain of the transistor Tp5a, and performs an auto-zero operation by equalizing the potential between the gate and drain of the transistor Tp5a before detection of the pixel signal VSL.
[0137] The comparator 121b includes an n-type transistor Tn5b, a p-type transistor Tp5b, a constant current source CS2b, and AZ switches SW4b and SW5b.
[0138] The gate of the transistor Tn5b is connected to the other end of the input capacitance element Cvslb. The drain of the transistor Tn5b is connected to the power supply Vdd, and the source of the transistor Tn5b is connected to the source of the transistor Tp5b. The transistor Tn5b generates a signal of a voltage level corresponding to the pixel signal VSL and transmits it to the source of the transistor Tp5b.
[0139] The gate of the transistor Tp5b as the second transistor is connected to the other end of the input capacitance element Crmpb. The source of the transistor Tp5b is connected to the source of the transistor Tn5b, and the drain of the transistor Tp5b is connected to the constant current source CS2b and the output part Toutb. The transistor Tp5b is turned on based on the voltage difference Vgs between the source voltage and the gate voltage.
[0140] For example, when the reference signal RAMP falls below the pixel signal VSL, the transistor Tp5b changes from a non-conductive state to a conductive state. The constant current source CS2b passes a constant current through the transistors Tn5b and Tp5b. Therefore, when the transistor Tp5b is in a non-conductive state, the output signal OUTb is at a low level, and when the transistor Tp5b is in a conductive state, the output signal OUTb is at a high level. That is, when the reference signal RAMP falls below the pixel signal VSL, the output signal OUTb is inverted from a low level to a high level. In this way, the transistor Tp5b can generate the output signal OUTb by amplifying the difference voltage between the pixel signal VSL and the reference signal RAMP.
[0141] The AZ switch SW4b is connected between the gate and drain of the transistor Tn5b, and performs an auto-zero operation by equalizing the potential between the gate and drain of the transistor Tn5b before detection of the pixel signal VSL.
[0142] The AZ switch SW5b is connected between the gate and drain of the transistor Tp5b, and performs an auto-zero operation by equalizing the potential between the gate and drain of the transistor Tp5b before detection of the pixel signal VSL.
[0143] FIG. 10 is a timing chart showing an example of the operation of the solid-state imaging device 100 according to the third embodiment. In the third embodiment, the reference signal RAMP decreases linearly from a level higher than the pixel signal VSL. That is, the reference signal RAMP may be the reference signal RAMP of the first embodiment with the polarity inverted. Therefore, the output signals OUTa and OUTb are inverted when the reference signal RAMP falls below the pixel signal VSL. Other operations of the third embodiment may be similar to the corresponding operations of the first embodiment, and therefore detailed description thereof will be omitted. The operations of the AZ switches SW4a, SW4b, SW5a, and SW5b may be the same as the AZ switches SW1a and SW1b of the first embodiment. The third embodiment has the capacitance units 120a and 102b like the first embodiment, and can obtain the same effects as the first embodiment.
[0144] (Fourth embodiment) FIG. 11 is a diagram showing an example of the configuration of a solid-state imaging device 100 according to the fourth embodiment. The fourth embodiment is different from the third embodiment in that the input capacitance elements Cvsla and Cvslb, the constant current source CS1a, the transistors Tn5a and Tn5b, and the AZ switches SW4a and SW4b are omitted, and the input capacitance elements Cgnda and Cgndb are added. The gate of the transistor Tp5a is connected to one end of the input capacitance element Crmpa and receives the reference signal RAMP via the input capacitance element Crmpa. The gate of the transistor Tp5a is connected to one end of the input capacitance element Cgnda and is connected to the ground GND via the input capacitance element Cgnda. The source of the transistor Tp5a is connected to the vertical signal line 110 and receives the pixel signal VSL. The gate of the transistor Tp5b is connected to one end of the input capacitance element Crmpb and receives the reference signal RAMP via the input capacitance element Crmpb. The gate of the transistor Tp5b is connected to one end of the input capacitance element Cgndb and is connected to the ground GND via the input capacitance element Cgndb. The source of the transistor Tp5b is connected to the vertical signal line 110 and receives the pixel signal VSL. The transistors Tp5a and Tp5b receive the same reference signal RAMP at their gates via the input capacitance elements Crmpa and Crmpb. The transistors Tp5a and Tp5b also receive the same pixel signal VSL from the vertical signal line 110.
[0145] One end of the input capacitance elements Crmpa and Crmpb is commonly connected to the reference signal line 114, and the other end is connected to the gates of the transistors Tp5a and Tp5b, respectively. The sources of the transistors Tp5a and Tp5b are commonly connected to the vertical signal line 110. One end of the input capacitance elements Cgnda and Cgndb is commonly connected to the gates of the transistors Tp5a and Tp5b, and the other end is connected to the ground GND.
[0146] The input capacitance elements Cgnda and Cgndb may be variable capacitance elements like the input capacitance elements Crmpa and Crmp. In the fourth embodiment, the input capacitance element gains Ga and Gb are set by making the capacitances of the input capacitance elements Cgnda and Cgndb different from each other. For example, the input capacitance gain Ga is determined by the capacitance ratio of the input capacitance element Cgnda to the input capacitance element Crmpa (e.g., Cgnda / Cgnda+Crmpa). The input capacitance gain Gb is determined by the capacitance ratio of the input capacitance element Cgndb to the input capacitance element Crmpb (e.g., Cgndb / Cgndb+Crmpb).
[0147] The current source that supplies a current to the vertical signal line 110 and the constant current that supplies a current to the comparators Tp5a and Tp5b are shared by the constant current sources CS2a and CS2b. Therefore, the constant current sources CS2a and CS2b supply a constant current to the vertical signal line 110 and also supply a constant current to the comparators Tp5a and Tp5b, respectively. This makes the power consumption of the solid-state imaging device 100 according to the fourth embodiment smaller than that of the third embodiment.
[0148] Furthermore, the pixel signal VSL is directly input to the transistor Tp5a without passing through the transistor Tn5a of Fig. 9. The pixel signal VSL is directly input to the transistor Tp5b without passing through the transistor Tn5b of Fig. 9. In this way, since the constant current source CS1a, the transistors Tn5a and Tn5b, and the AZ switches SW4a and SW4b are omitted, the layout area of the ADC groups 105a and 105b in the fourth embodiment is smaller than that in the third embodiment.
[0149] Other configurations of the fourth embodiment may be similar to the corresponding configurations of the third embodiment. Furthermore, the operation of the fourth embodiment may be similar to the operation of the third embodiment. Therefore, the fourth embodiment can also obtain the same effects as the third embodiment.
[0150] (Variation 1) FIG. 12 is a diagram showing a configuration example of a solid-state imaging device 100 according to a first modification of the first embodiment. In the first embodiment, two ADC groups 105a, 105b are connected in parallel to each pixel column. In contrast, in the first modification, three or more ADC groups 105a, 105b, 105c, etc. are connected in parallel to each pixel column. The ADC groups 105a, 105b, 105c, etc. have capacitance units 120a, 120b, 120c, etc. with different input capacitance gains. In this way, the solid-state imaging device 100 may be provided with three or more ADC groups 105a, 105b, 105c, etc. corresponding to each pixel column. This can further increase the dynamic range of detectable irradiated light.
[0151] (Variation 2) FIG. 13 is a table showing the relationship between the exposure time and the input capacitance gain of the solid-state imaging device 100 according to the second modification. In the above embodiment, the exposure time of the pixel unit 101 may be the same, but the exposure time may be changed according to the illuminance of the irradiated light. The exposure time may be changed by the timing control circuit 102. For example, the solid-state imaging device 100 allows the exposure time of the pixel unit 101 to be selected between a relatively long first exposure time and a relatively short second exposure time. In this case, the ADC groups 105a and 105b detect the pixel signals VSL of the first and second exposure times with the input capacitance gains Ga and Gb, respectively. Therefore, a total of four types of first to fourth image data are obtained. That is, the first image data is image data obtained by detecting the pixel signal VSL obtained in the relatively long first exposure time with a relatively low input capacitance gain Ga. The second image data is image data obtained by detecting the pixel signal VSL obtained in the relatively short second exposure time with a relatively low input capacitance gain Ga. The third image data is image data obtained by detecting the pixel signal VSL obtained in a relatively long first exposure time with a relatively high input capacitance gain Gb, and the fourth image data is image data obtained by detecting the pixel signal VSL obtained in a relatively short second exposure time with a relatively high input capacitance gain Gb.
[0152] The signal processing circuit 108 selects appropriate image data from these four image data, or generates one image data by combining a plurality of image data from these four image data. For example, when the illuminance of the irradiated light is low (dark), the signal processing circuit 108 may select the third image data with a long exposure time and a high gain. For example, when the illuminance of the irradiated light is high (bright), the signal processing circuit 108 may select the second image data with a short exposure time and a low gain.
[0153] In this way, in the second modification, the dynamic range of pixel signals detectable by the solid-state imaging device 100 is expanded by the combination of the exposure time and the input capacitance gain.
[0154] (Variation 3) Fig. 14 is a timing chart showing an example of the operation of the solid-state imaging device 100 according to Modification 3. Fig. 15 is a table showing combinations of reference signals and input capacitance gains according to Modification 3.
[0155] In the above embodiment, the voltage level of the reference signal RAMP increases or decreases linearly with a substantially equal slope, but the slope of the reference signal RAMP may be switched. For example, Fig. 14 shows the reference signal RAMP from t9 to t10 in Fig. 10. The reference signal RAMPa decreases linearly with a relatively small slope, and the reference signal RAMPb decreases linearly with a relatively large slope.
[0156] The reference signals RAMPa and RAMPb are switched by the DAC 104. Low-illuminance irradiated light, in which the voltage level of the pixel signal VSL is higher than the threshold, is detected with high sensitivity by the reference signal RAMPa. On the other hand, high-illuminance irradiated light, in which the voltage level of the pixel signal VSL is lower than the threshold, can be detected in a relatively short time (low power consumption) by the reference signal RAMPb.
[0157] As shown in FIG. 15, in the third modification, the input capacitance gains Ga and Gb according to the present embodiment are combined with the reference signals RAMPa and RAMPb. That is, the ADC groups 105a and 105b detect the pixel signal VSL at the input capacitance gains Ga and Gb using the reference signal RAMPa or RAMPb. As a result, in the third modification, a total of four types of first to fourth image data are obtained, similar to the second modification. That is, the first image data is image data obtained by detecting the pixel signal VSL at a relatively low input capacitance gain Ga using the reference signal RAMPa. The second image data is image data obtained by detecting the pixel signal VSL at a relatively low input capacitance gain Ga using the reference signal RAMPb. The third image data is image data obtained by detecting the pixel signal VSL at a relatively high input capacitance gain Gb using the reference signal RAMPa. And the fourth image data is image data obtained by detecting the pixel signal VSL at a relatively high input capacitance gain Gb using the reference signal RAMPb.
[0158] The signal processing circuit 108 selects appropriate image data from these four image data, or generates one image data by combining a plurality of image data from these four image data. For example, when the illuminance of the irradiated light is low (dark), the signal processing circuit 108 may select the third image data detected at a high gain Gb using a reference signal RAMPa with a small slope. For example, when the illuminance of the irradiated light is high (bright), the signal processing circuit 108 may select the second image data detected at a low gain ga using a reference signal RAMPb with a large slope.
[0159] In this way, in the third modification, the dynamic range of pixel signals detectable by the solid-state imaging device 100 is expanded by the combination of the reference signal and the input capacitance gain.
[0160] Modifications 1 to 3 are applicable to any of the first to fifth embodiments. Modifications 1 to 3 may be combined with each other. For example, by combining Modifications 2 and 3, the dynamic range of pixel signals detectable by the solid-state imaging device 100 can be further widened by a combination of exposure time, reference signal, and input capacitance gain.
[0161] Fifth embodiment Fig. 16 is a block diagram showing a configuration example of a solid-state imaging element 100 according to the fifth embodiment. Fig. 17 is a block diagram showing a configuration example of the ADC groups 105a and 105b according to the fifth embodiment. The solid-state imaging element 100 according to the fifth embodiment switches or controls the gains of the ADC groups 105a and 105b according to the illuminance of the irradiated light. For this purpose, the solid-state imaging element 100 further includes a control unit 130 and a register 140.
[0162] Before imaging, the signal processing circuit 108 detects the illuminance of the incident light irradiated on the pixel unit 101 based on the pixel signal supplied from the amplifier circuit 107. The signal processing circuit 108 acquires the illuminance using all or part of the pixel signals of the pixel unit 101. Since the illuminance does not require the same resolution as the image data, there is no need to perform CDS, and the slope of the reference signal RAMP may be steep. Therefore, the illuminance can be detected in a short time. The signal processing circuit 108 may calculate the illuminance data based on the statistical values (e.g., the average, the median, the mode) of the pixel signals from a predetermined pixel. The statistical values may be interpolated by any linear or nonlinear operation. The illuminance detection and calculation may be performed outside the solid-state imaging device 100.
[0163] The control unit 130 obtains illuminance data from the signal processing circuit 108, and changes the settings of the DAC 104 and / or the capacitance units 120a and 120b based on the setting data from the register 140. For example, when the illuminance is lower than a threshold, the control unit 130 increases the capacitance of the input capacitance elements Cvsla and Cvslb of the capacitance units 120a and 120b to increase the input capacitance gain. When the illuminance is equal to or higher than a threshold, the control unit 130 decreases the capacitance of the input capacitance elements Cvsla and Cvslb of the capacitance units 120a and 120b to decrease the input capacitance gain. The control unit 130 and the register 140 may be provided either inside or outside the solid-state imaging device 100.
[0164] FIG. 18 is a diagram showing an example of the configuration of the input capacitance elements Cvsla, Cvslb. The input capacitance elements Cvsla, Cvslb are variable capacitance elements composed of a plurality of capacitance elements Ce connected in parallel via switches SWc1, SWc2. The SW control signal from the control unit 130 controls the switches SWc1, SWc2 to be on or off, thereby controlling the number of capacitance elements Ce connected in parallel. This makes it possible to change the capacitance of the input capacitance elements Cvsla, Cvslb. Note that the number of switches SWc1, SWc2 and capacitance elements Ce is not particularly limited. The configuration of FIG. 18 may also be applied to the input capacitance elements Crmpa, Crmpb.
[0165] Referring again to FIG. 17, the register 140 stores an illuminance threshold in advance, and transmits the threshold to the control unit 130 as setting data. The register 140 may store a plurality of thresholds. This allows the control unit 130 to control the plurality of switches SWc1 and SWc2 in FIG. 18 and to control the capacitance of the input capacitance elements Cvsla and Cvslb in stages. For example, when the illuminance falls below the first threshold, the control unit 130 may turn on the switch SWc1, and when the illuminance further falls below the second threshold (<first threshold), the control unit 130 may further turn on the switch SWc2.
[0166] After the control unit 130 sets the input capacitance gain of the capacitance units 120a and 120b, the pixel unit 101 performs imaging with the set input capacitance gain, and the signal processing circuit 108 converts the pixel signal and outputs image data.
[0167] 19 is a flow chart showing the operation of the solid-state imaging device 100 according to the fifth embodiment. The solid-state imaging device 100 measures the illuminance of light irradiated onto the pixel unit 101 for each frame, and then performs imaging.
[0168] In imaging a certain frame, first, the vertical scanning circuit 103 sets a readout row of the pixel section 101 (S100). Next, the pixel row of the pixel section 101 outputs a pixel signal based on the detected irradiated light (S110). Next, the ADC group 105a, 105b performs AD conversion on the pixel signal (S120). Next, the latch circuit 123 outputs the AD converted illuminance data to the signal processing circuit 108 (S130). Steps S100 to S130 are executed up to the last row of the pixel section 101 (NO in S140).
[0169] When the signal processing circuit 108 acquires illuminance data up to the last row of the pixel unit 101 (YES in S140), the signal processing circuit 108 generates illuminance data for the entire frame (S150) and outputs the illuminance data to the control unit 130 (S160). Next, the control unit 130 determines the illuminance based on the setting data from the register 140, and sets and outputs a SW control signal or a DAC control signal according to the illuminance for each pixel row. The input capacitance gain of the capacitance units 120a and 120b is controlled by the SW control signal. Alternatively, the slope of the reference signal RAMP from the DAC 104 is controlled by the DAC control signal.
[0170] Next, the solid-state imaging device 100 starts capturing the image of that frame.
[0171] Steps S180 to S220 are similar to steps S100 to S140.
[0172] Next, the signal processing circuit 108 generates image data for the entire frame (S230) and outputs the image data to the outside of the solid-state imaging device 100 (S240). This allows the image data to be generated with an appropriate input capacitance gain or reference signal RAMP according to the illuminance of the irradiated light.
[0173] In this way, by repeating the illuminance measurement and image capture for each frame, the solid-state imaging device 100 can capture an image with an optimal gain for each frame. Note that the illuminance measurement does not necessarily have to be performed for each frame, and may be performed, for example, every few frames.
[0174] When the pixel unit 101 is used to measure illuminance and capture an image, the control unit 130 may switch the input capacitance gain of the capacitance units 120a and 120b between a measurement mode for measuring illuminance and an image capture mode for capturing an image. For example, in the measurement mode, the control unit 130 may lower the input capacitance gain since it is sufficient to detect pixel signals with low sensitivity and in a short time. Alternatively, in the measurement mode, the signal processing circuit 108 may select the output signal OUTa obtained using a low gain.
[0175] The control unit 130 may control the DAC 104 together with or instead of the switches SWc1 and SWc2. For example, the control unit 130 changes the slope of the reference signal RAMP by the DAC control signal. This allows the slope of the reference signal RAMP to be changed according to the illuminance of the irradiated light, making it possible to operate as in the above-mentioned modified example 3.
[0176] In the first to fourth embodiments, the signal processing circuit 108 selects the output signals OUTa and OUTb. In this case, the signal processing circuit 108 may select the output signals OUTa and OUTb in accordance with the detected illuminance.
[0177] The technology according to the present disclosure (the present technology) can be applied to various products. For example, the technology according to the present disclosure may be realized as a device mounted on any type of moving body such as an automobile, an electric vehicle, a hybrid electric vehicle, a motorcycle, a bicycle, a personal mobility device, an airplane, a drone, a ship, a robot, etc.
[0178] FIG. 20 is a block diagram showing a schematic configuration example of a vehicle control system, which is an example of a moving object control system to which the technology according to the present disclosure can be applied.
[0179] The vehicle control system 12000 includes a plurality of electronic control units connected via a communication network 12001. In the example shown in Fig. 20, the vehicle control system 12000 includes a drive system control unit 12010, a body system control unit 12020, an outside-vehicle information detection unit 12030, an inside-vehicle information detection unit 12040, and an integrated control unit 12050. Also, as functional configurations of the integrated control unit 12050, a microcomputer 12051, an audio / video output unit 12052, and an in-vehicle network I / F (interface) 12053 are illustrated.
[0180] The drivetrain control unit 12010 controls the operation of devices related to the drivetrain of the vehicle in accordance with various programs. For example, the drivetrain control unit 12010 functions as a control device for a drive force generating device for generating a drive force of the vehicle, such as an internal combustion engine or a drive motor, a drive force transmission mechanism for transmitting the drive force to the wheels, a steering mechanism for adjusting the steering angle of the vehicle, and a braking device for generating a braking force of the vehicle.
[0181] The body system control unit 12020 controls the operation of various devices mounted on the vehicle body according to various programs. For example, the body system control unit 12020 functions as a control device for a keyless entry system, a smart key system, a power window device, or various lamps such as head lamps, back lamps, brake lamps, turn signals, and fog lamps. In this case, radio waves or signals of various switches transmitted from a portable device that replaces a key may be input to the body system control unit 12020. The body system control unit 12020 receives the input of these radio waves or signals and controls the door lock device, power window device, lamps, and the like of the vehicle.
[0182] The outside-vehicle information detection unit 12030 detects information outside the vehicle equipped with the vehicle control system 12000. For example, an imaging unit 12031 is connected to the outside-vehicle information detection unit 12030. The outside-vehicle information detection unit 12030 causes the imaging unit 12031 to capture an image outside the vehicle and receives the captured image. The outside-vehicle information detection unit 12030 may perform object detection processing or distance detection processing for a person, a car, an obstacle, a sign, or characters on a road surface based on the received image. The solid-state imaging element 100 according to the present disclosure may be provided in the imaging unit 12031.
[0183] The imaging unit 12031 is an optical sensor that receives light and outputs an electrical signal according to the amount of light received. The imaging unit 12031 can output the electrical signal as an image, or as distance measurement information. The light received by the imaging unit 12031 may be visible light, or may be invisible light such as infrared light. The solid-state imaging element 100 according to the present disclosure may be the imaging unit 12031, or may be provided separately from the imaging unit 12031.
[0184] The in-vehicle information detection unit 12040 detects information inside the vehicle. For example, a driver state detection unit 12041 that detects the state of the driver is connected to the in-vehicle information detection unit 12040. The driver state detection unit 12041 includes, for example, a camera that captures an image of the driver, and the in-vehicle information detection unit 12040 may calculate the degree of fatigue or concentration of the driver based on the detection information input from the driver state detection unit 12041, or may determine whether the driver is dozing.
[0185] The microcomputer 12051 can calculate control target values for the driving force generating device, the steering mechanism, or the braking device based on the information inside and outside the vehicle acquired by the outside-of-vehicle information detection unit 12030 or the inside-vehicle information detection unit 12040, and output a control command to the drive system control unit 12010. For example, the microcomputer 12051 can perform cooperative control aimed at realizing the functions of an ADAS (Advanced Driver Assistance System), including vehicle collision avoidance or impact mitigation, following driving based on the inter-vehicle distance, vehicle speed maintenance driving, vehicle collision warning, vehicle lane departure warning, etc.
[0186] In addition, the microcomputer 12051 can perform cooperative control for the purpose of autonomous driving, which allows the vehicle to travel autonomously without relying on the driver's operation, by controlling the driving force generating device, steering mechanism, braking device, etc. based on information about the surroundings of the vehicle acquired by the outside vehicle information detection unit 12030 or the inside vehicle information detection unit 12040.
[0187] Furthermore, the microcomputer 12051 can output a control command to the body system control unit 12020 based on the information outside the vehicle acquired by the outside-vehicle information detection unit 12030. For example, the microcomputer 12051 can control the headlamps according to the position of a preceding vehicle or an oncoming vehicle detected by the outside-vehicle information detection unit 12030, and perform cooperative control for the purpose of preventing glare, such as switching from high beams to low beams.
[0188] The audio / image output unit 12052 transmits at least one output signal of audio and image to an output device capable of visually or audibly notifying information to passengers in the vehicle or the outside of the vehicle. Examples of the output device include an audio speaker 12061, a display unit 12062, and an instrument panel 12063. The display unit 12062 may include at least one of an on-board display and a head-up display, for example.
[0189] FIG. 21 is a diagram showing an example of the installation position of the imaging unit 12031.
[0190] In FIG. 21, a vehicle 12100 has imaging units 12101, 12102, 12103, 12104, and 12105 as an imaging unit 12031.
[0191] The imaging units 12101, 12102, 12103, 12104, and 12105 are provided at positions such as the front nose, side mirrors, rear bumper, back door, and the upper part of the windshield inside the vehicle cabin of the vehicle 12100. The imaging unit 12101 provided at the front nose and the imaging unit 12105 provided at the upper part of the windshield inside the vehicle cabin mainly acquire images of the front of the vehicle 12100. The imaging units 12102 and 12103 provided at the side mirrors mainly acquire images of the sides of the vehicle 12100. The imaging unit 12104 provided at the rear bumper or back door mainly acquires images of the rear of the vehicle 12100. The images of the front acquired by the imaging units 12101 and 12105 are mainly used to detect a preceding vehicle, a pedestrian, an obstacle, a traffic light, a traffic sign, a lane, or the like.
[0192] 21 shows an example of the imaging ranges of the imaging units 12101 to 12104. Imaging range 12111 indicates the imaging range of the imaging unit 12101 provided on the front nose, imaging ranges 12112 and 12113 indicate the imaging ranges of the imaging units 12102 and 12103 provided on the side mirrors, respectively, and imaging range 12114 indicates the imaging range of the imaging unit 12104 provided on the rear bumper or back door. For example, an overhead image of the vehicle 12100 viewed from above is obtained by superimposing the image data captured by the imaging units 12101 to 12104.
[0193] At least one of the imaging units 12101 to 12104 may have a function of acquiring distance information. For example, at least one of the imaging units 12101 to 12104 may be a stereo camera made up of a plurality of imaging elements, or may be an imaging element having pixels for detecting a phase difference.
[0194] For example, the microcomputer 12051 can extract, as a preceding vehicle, a three-dimensional object that is the closest three-dimensional object on the travel path of the vehicle 12100 and travels at a predetermined speed (for example, 0 km / h or more) in approximately the same direction as the vehicle 12100, by calculating the distance to each three-dimensional object in the image capture ranges 12111 to 12114 and the change over time of this distance (relative speed with respect to the vehicle 12100) based on the distance information obtained from the image capture units 12101 to 12104. Furthermore, the microcomputer 12051 can set a vehicle distance to be secured in advance in front of the preceding vehicle, and perform automatic brake control (including follow-up stop control) and automatic acceleration control (including follow-up start control). In this way, cooperative control can be performed for the purpose of automatic driving that runs autonomously without relying on the driver's operation.
[0195] For example, the microcomputer 12051 classifies and extracts three-dimensional object data on three-dimensional objects into two-wheeled vehicles, ordinary vehicles, large vehicles, pedestrians, utility poles, and other three-dimensional objects based on distance information obtained from the imaging units 12101 to 12104, and can use the data for automatic obstacle avoidance. For example, the microcomputer 12051 distinguishes obstacles around the vehicle 12100 into obstacles that are visible to the driver of the vehicle 12100 and obstacles that are difficult to see. Then, the microcomputer 12051 determines a collision risk indicating the risk of collision with each obstacle, and when the collision risk is equal to or greater than a set value and a collision is possible, the microcomputer 12051 can provide driving assistance for collision avoidance by outputting an alarm to the driver via the audio speaker 12061 or the display unit 12062, or by performing forced deceleration or avoidance steering via the drive system control unit 12010.
[0196] At least one of the imaging units 12101 to 12104 may be an infrared camera that detects infrared rays. For example, the microcomputer 12051 can recognize a pedestrian by determining whether or not a pedestrian is present in the captured images of the imaging units 12101 to 12104. The recognition of such a pedestrian is performed, for example, by a procedure of extracting feature points in the captured images of the imaging units 12101 to 12104 as infrared cameras, and a procedure of performing pattern matching processing on a series of feature points that indicate the contour of an object to determine whether or not the object is a pedestrian. When the microcomputer 12051 determines that a pedestrian is present in the captured images of the imaging units 12101 to 12104 and recognizes the pedestrian, the audio / image output unit 12052 controls the display unit 12062 to superimpose a rectangular contour line for emphasis on the recognized pedestrian. The audio / image output unit 12052 may also control the display unit 12062 to display an icon or the like indicating a pedestrian at a desired position.
[0197] As described above, the technology according to the present disclosure can be applied to, for example, the vehicle outside information detection unit 12030. Specifically, the above-described imaging unit 12031 can be implemented in the vehicle outside information detection unit 12030. By applying the technology according to the present disclosure to the imaging unit 12031, accurate distance information can be obtained in an environment with a wide brightness dynamic range, and the functionality and safety of the vehicle 12100 can be improved.
[0198] The present technology can be configured as follows. (1) A pixel portion including a plurality of pixels; a pixel signal line for transmitting a pixel signal of the pixel; a reference signal line transmitting a reference signal to be compared with the pixel signal; a first comparator that outputs a first output signal corresponding to the pixel signal based on a voltage difference between the pixel signal and the reference signal; a second comparator that outputs a second output signal corresponding to the pixel signal based on a voltage difference between the pixel signal and the reference signal; a first capacitance section provided between the pixel signal line or the reference signal line and the first comparator, the first capacitance section being set to a first gain; a second capacitance section set to a second gain, the second capacitance section being provided between the pixel signal line or the reference signal line and the second comparator. (2) The first capacitance section is a first input capacitance element provided between the reference signal line and the first comparator; a second input capacitance element provided between the pixel signal line and the first comparator; The second capacitance section is a third input capacitance element provided between the reference signal line and the second comparator; and a fourth input capacitance element provided between the pixel signal line and the second comparator. (3) The solid-state imaging element according to (2), wherein a capacitance ratio between the first input capacitance element and the second input capacitance element is different from a capacitance ratio between the third input capacitance element and the fourth input capacitance element. (4) The solid-state imaging device according to (2) or (3), wherein the first and third input capacitance elements have substantially the same capacitance, and the second and fourth input capacitance elements have different capacitances. (5) a gain of the first capacitance section is determined by a capacitance ratio between the first input capacitance element and the second input capacitance element; The solid-state imaging element according to (3) or (4), wherein a gain of the second capacitance section is determined by a capacitance ratio between the third input capacitance element and the fourth input capacitance element. (6) one end of each of the first and third input capacitance elements is commonly connected to the reference signal line; one end of each of the second and fourth input capacitance elements is commonly connected to the pixel signal line; the first comparator includes a first transistor having a gate commonly connected to the other end of the first and second input capacitance elements; The solid-state imaging element according to any one of (2) to (5), wherein the second comparator includes a second transistor having a gate commonly connected to the other ends of the third and fourth input capacitance elements. (7) the first comparator further includes a first constant current source connected to one end of the first transistor, and outputs the first output signal from between the first transistor and the first constant current source; The solid-state imaging element described in (6), wherein the second comparator further includes a second constant current source connected to one end of the second transistor, and outputs the second output signal from between the second transistor and the second constant current source. (8) the first comparator further includes a first constant current source connected to one end of the first transistor, a third transistor having one end connected to the first constant current source, and a first mirror circuit connected to the other ends of the first and third transistors, and outputs the first output signal from between the third transistor and the first mirror circuit; The solid-state imaging element described in (6), wherein the second comparator further includes a second constant current source connected to one end of the second transistor, a fourth transistor having one end connected to the second constant current source, and a second mirror circuit connected to the other ends of the first and fourth transistors, and outputs the second output signal from between the fourth transistor and the second mirror circuit. (9) the first comparator includes a first transistor having a gate connected to the first input capacitance element and one end connected to the second input capacitance element; The solid-state imaging element according to (2), wherein the second comparator includes a second transistor having a gate connected to the third input capacitance element and one end connected to the fourth input capacitance element. (10) the first and third input capacitance elements are commonly connected to the reference signal line; The solid-state imaging element according to (9), wherein one terminal of each of the first and second transistors receives a pixel signal via the second and fourth input capacitance elements, respectively. (11) The solid-state imaging device according to any one of (2) to (10), further comprising a reference signal generating section that supplies the same reference signal to the first and third input capacitance elements. (12) The solid-state imaging element according to any one of (1) to (10), further comprising a signal processing circuit that selects either the first or second output signal depending on the illuminance of light irradiating the pixel portion and outputs it as image data. (13) The solid-state imaging device according to any one of (1) to (12), further comprising a control unit that changes an exposure time of the pixel unit in accordance with an illuminance of light irradiating the pixel unit. (14) The solid-state imaging element according to any one of (1) to (13), further comprising a control unit configured to control a slope of the reference signal in accordance with an illuminance of light irradiating the pixel unit. (15) The solid-state imaging device according to any one of (1) to (14), further comprising a control unit that controls the first or second gain in response to an illuminance of light irradiating the pixel unit. (16) A signal processing circuit (108) for acquiring an illuminance of light irradiated onto the pixel unit; a control unit (130) that sets the first or second gain according to the illuminance, the pixel unit performs imaging at the set first or second gain to generate the pixel signal; The solid-state imaging device according to any one of (1) to (10), wherein the signal processing circuit converts the pixel signals to generate image data. (17) one end of each of the first and third input capacitance elements is commonly connected to the reference signal line; one end of each of the second and fourth input capacitance elements is commonly connected to the pixel signal line; the first comparator includes a first transistor having a gate connected to the other end of the first input capacitance element, and a third transistor having a gate connected to the other end of the second input capacitance element; A solid-state imaging element described in any one of (2) to (5), wherein the second comparator includes a second transistor having a gate connected to the other end of the third input capacitance element and a fourth transistor having a gate connected to the other end of the fourth input capacitance element.
[0199] The present disclosure is not limited to the above-described embodiment, and various modifications are possible without departing from the scope of the present disclosure. Furthermore, the effects described in this specification are merely examples and are not limiting, and other effects may be obtained. [Explanation of symbols]
[0200] 101 pixel section, 150 pixel, 105a, 105b ADC group, 110 vertical signal line, 120a, 120b capacitance section, 121a, 121b comparator, Crmpa, Cvsla, Crmpb, Cvslb input capacitance element, Tp1a to Tp5a, Tp1b to Tp5b, Tn1a to Tn5a, Tn1b to Tn5b transistor
Claims
1. A pixel portion including a plurality of pixels; a pixel signal line for transmitting a pixel signal of the pixel; a reference signal line transmitting a reference signal to be compared with the pixel signal; a first comparator that outputs a first output signal corresponding to the pixel signal based on a voltage difference between the pixel signal and the reference signal; a second comparator that outputs a second output signal corresponding to the pixel signal based on a voltage difference between the pixel signal and the reference signal; a first capacitance section provided between the pixel signal line or the reference signal line and the first comparator, the first capacitance section being set to a first gain; a second capacitance section provided between the pixel signal line or the reference signal line and the second comparator, the second capacitance section being set to a second gain higher than the first gain.
2. The first capacitance section is a first input capacitance element provided between the reference signal line and the first comparator; a second input capacitance element provided between the pixel signal line and the first comparator; The second capacitance section is a third input capacitance element provided between the reference signal line and the second comparator; The solid-state imaging device according to claim 1 , further comprising: a fourth input capacitance element provided between the pixel signal line and the second comparator.
3. 3. The solid-state imaging device according to claim 2, wherein a capacitance ratio between the first input capacitance element and the second input capacitance element is different from a capacitance ratio between the third input capacitance element and the fourth input capacitance element.
4. 3. The solid-state imaging device according to claim 2, wherein said first and third input capacitance elements have substantially the same capacitance, and said second and fourth input capacitance elements have different capacitances.
5. a gain of the first capacitance unit is determined by a capacitance ratio between the first input capacitance element and the second input capacitance element, 4. The solid-state imaging device according to claim 3, wherein a gain of said second capacitance section is determined by a capacitance ratio between said third input capacitance element and said fourth input capacitance element.
6. one end of each of the first and third input capacitance elements is commonly connected to the reference signal line; one end of each of the second and fourth input capacitance elements is commonly connected to the pixel signal line; the first comparator includes a first transistor having a gate commonly connected to the other end of the first and second input capacitive elements; 3. The solid-state imaging device according to claim 2, wherein the second comparator includes a second transistor having a gate commonly connected to the other ends of the third and fourth input capacitance elements.
7. the first comparator further includes a first constant current source connected to one end of the first transistor, and outputs the first output signal from between the first transistor and the first constant current source; 7. The solid-state imaging element according to claim 6, wherein the second comparator further includes a second constant current source connected to one end of the second transistor, and outputs the second output signal from between the second transistor and the second constant current source.
8. the first comparator further includes a first constant current source connected to one end of the first transistor, a third transistor having one end connected to the first constant current source, and a first mirror circuit connected to the other ends of the first and third transistors, and outputs the first output signal from between the third transistor and the first mirror circuit; 7. The solid-state imaging device of claim 6, wherein the second comparator further includes a second constant current source connected to one end of the second transistor, a fourth transistor having one end connected to the second constant current source, and a second mirror circuit connected to the other ends of the first and fourth transistors, and outputs the second output signal from between the fourth transistor and the second mirror circuit.
9. the first comparator includes a first transistor having a gate connected to one end of the first and second input capacitance elements and one end connected to the pixel signal line; 3. The solid-state imaging device according to claim 2, wherein the second comparator includes a second transistor having a gate connected to one end of each of the third and fourth input capacitance elements and one end connected to the pixel signal line.
10. the other ends of the first and third input capacitive elements are commonly connected to the reference signal line; the other ends of the second and fourth input capacitive elements are grounded; 10. The solid-state imaging device according to claim 9, wherein each of the first and second transistors receives an identical pixel signal from the pixel signal line at one end.
11. The solid-state imaging device according to claim 2 , further comprising a reference signal generating section that supplies the same reference signal to the first and third input capacitance elements.
12. 2. The solid-state imaging device according to claim 1, further comprising a signal processing circuit that selects either the first or second output signal in accordance with an illuminance of light irradiating said pixel portion, and outputs the selected output signal as image data.
13. The solid-state imaging device according to claim 1 , further comprising a control unit that changes an exposure time of said pixel unit in accordance with an illuminance of light irradiating said pixel unit.
14. The solid-state imaging device according to claim 1 , further comprising a control unit that controls a slope of the reference signal in response to an illuminance of light irradiating the pixel unit.
15. The solid-state imaging device according to claim 1 , further comprising a control unit that controls the first or second gain in response to an illuminance of light irradiating the pixel unit.
16. a signal processing circuit for acquiring an illuminance of light irradiated onto the pixel unit; a control unit that sets the first gain or the second gain according to the illuminance, the pixel unit performs imaging at the set first or second gain to generate the pixel signal; 2. The solid-state imaging device according to claim 1, wherein the signal processing circuit converts the pixel signals to generate image data.
17. one end of each of the first and third input capacitance elements is commonly connected to the reference signal line; one end of each of the second and fourth input capacitance elements is commonly connected to the pixel signal line; the first comparator includes a first transistor having a gate connected to the other end of the first input capacitance element, and a third transistor having a gate connected to the other end of the second input capacitance element, 3. The solid-state imaging element according to claim 2, wherein the second comparator includes a second transistor having a gate connected to the other end of the third input capacitance element, and a fourth transistor having a gate connected to the other end of the fourth input capacitance element.
Citation Information
Patent Citations
Imaging device, control method therefor, and electronic apparatus
JP2018148541A
Solid state image sensor, imaging device, and solid state image sensor control method
JP2019165313A
Solid-state image pickup element, image pickup control method, signal processing method, and electronic apparatus
WO2016013412A1
Solid-state imaging element, imaging device, and method for controlling solid-state imaging element
WO2020031439A1