Imaging device

The imaging device addresses charge leakage issues by using a differentiation circuit and switching element to ensure accurate digital conversion of pixel signals, preventing white image blackening and maintaining image brightness, thereby improving image quality and frame rate.

WO2024236931A1PCT designated stage expired Publication Date: 2024-11-21SONY SEMICON SOLUTIONS CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2024/013913
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-12
Filing Date
2024-04-04
Publication Date
2024-11-21

AI Technical Summary

Technical Problem

In imaging devices, strong light can cause charge leakage from the floating diffusion even when the transfer transistor is turned off, leading to a phenomenon where a white image appears black due to voltage decrease on the data signal line, causing pixel signals in reset states to approach those with data, resulting in a loss of brightness.

Method used

An imaging device with a differentiation circuit that differentiates the pixel signal and compares the result with a threshold, using a switching element to control the conductive state based on the presence of incident light data, and a counter that sets the digital value to the maximum when the absolute value of the differential result exceeds the threshold, ensuring accurate digital conversion and maintaining image brightness.

Benefits of technology

This solution effectively prevents the blackening of white images by ensuring that pixel signals are accurately converted to maximum digital values when incident light intensity is high, maintaining image brightness and reducing the need for additional AD conversion processes, thus enhancing frame rate and image quality.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2024013913_21112024_PF_FP_ABST
    Figure JP2024013913_21112024_PF_FP_ABST
Patent Text Reader

Abstract

[Problem] To provide an imaging device capable of suppressing blackening of a white image. [Solution] An imaging device according to the present disclosure comprises: a pixel unit including a plurality of pixels that photoelectrically convert incident light to generate a pixel signal; a first signal line that transmits the pixel signal from the pixel unit; a signal processing unit that converts the pixel signal into a digital value; a differentiation circuit that is provided between the first signal line and the signal processing unit and that differentiates the pixel signal and outputs the differentiation result; and a first comparison unit that is provided between the differentiation circuit and the signal processing unit, and that compares the differentiation result with a predetermined threshold value to output the comparison result to the signal processing unit.
Need to check novelty before this filing date? Find Prior Art

Description

Imaging device

[0001] The present disclosure relates to an imaging device.

[0002] In imaging devices such as CMOS (Complementary Metal Oxide Semiconductor) image sensors, slope-type ADCs (Analog-to-Digital Converters) are used for AD conversion of pixel signals. The slope-type ADC includes a comparator and a counter. The comparator compares a pixel signal with a reference signal and outputs the comparison result to the counter. The counter measures the period from the start of comparison between the pixel signal and the reference signal to the inversion of the comparator output. The solid-state imaging element detects the level of the pixel signal based on the measurement period of the counter.

[0003] Japanese Patent Application Laid-Open No. 2020-28117

[0004] However, when strong light strikes a pixel, charge can leak from the floating diffusion even when the transfer transistor in the pixel is turned off. In this case, the voltage on the data signal line drops, causing the pixel signal in the reset state, which does not contain data, to approach the pixel signal containing data. This causes a white image to become slightly black.

[0005] Therefore, the present disclosure provides an imaging device that can prevent a white image from turning black.

[0006] An imaging device according to one aspect of the present disclosure includes a pixel section including a plurality of pixels that photoelectrically convert incident light to generate pixel signals, a first signal line that transmits the pixel signals from the pixel section, a signal processing section that converts the pixel signals into digital values, a differentiation circuit that is provided between the first signal line and the signal processing section and differentiates the pixel signals and outputs the differentiation result, and a first comparison section that is provided between the differentiation circuit and the signal processing section and compares the differentiation result with a predetermined threshold value and outputs the comparison result to the signal processing section.

[0007] If the absolute value of the differentiation result of the pixel signal not including incident light data is equal to or greater than the absolute value of the threshold, the first comparing section inverts the comparison result.

[0008] When the first comparing section inverts the comparison result, the signal processing section sets the digital value to the maximum value.

[0009] The power supply further includes a switching element provided between the differentiating circuit and the first signal line.

[0010] The switching element is in a conductive state during the period when a pixel signal not including incident light data is being converted into a digital value.

[0011] A plurality of first signal lines are provided, and a differentiating circuit and a first comparing unit are provided for each of the first signal lines.

[0012] A plurality of first signal lines are provided, and the differentiating circuit and the first comparing unit are provided on first signal lines that are intermittently selected from the plurality of first signal lines.

[0013] The signal processing unit includes a second comparison unit that compares the pixel signal with a reference signal whose voltage changes at a predetermined slope and inverts the output when the reference signal crosses the pixel signal, and a counter that counts the clock signal during the period from when the reference signal starts to change to when the output of the second comparison unit inverts, and when the first comparison unit inverts the comparison result, the counter sets the count value to its maximum value.

[0014] The switching element is in a conductive state during the period in which a pixel signal containing incident light data is converted into a digital value.

[0015] The switching element becomes conductive when a first period has elapsed since the start of digital conversion of a pixel signal that does not include data on incident light, and becomes conductive when the first period has elapsed since the start of digital conversion of a pixel signal that includes data on incident light.

[0016] A plurality of first signal lines are provided, and the differentiating circuit and the first comparing section are provided in common to the plurality of first signal lines.

[0017] The imaging device further includes a plurality of first switching elements provided between the differentiation circuit and each of the plurality of first signal lines, and a plurality of second switching elements provided between the first comparison unit and a signal processing unit corresponding to each of the plurality of first signal lines.

[0018] The plurality of first switching elements and the plurality of second switching elements are provided corresponding to the plurality of first signal lines, respectively.

[0019] The plurality of first switching elements and the plurality of second switching elements are provided corresponding to first signal lines that are intermittently selected from the plurality of first signal lines.

[0020] The imaging device further includes a current circuit that causes a current to flow through the first signal line, and the differentiating circuit and the first comparing unit are disposed at a position farther from the pixel unit than the current circuit.

[0021] 1 is a block diagram showing an example of the configuration of an imaging device according to a first embodiment. FIG. 2 is a block diagram showing an example of the configuration of a solid-state imaging element according to the first embodiment. FIG. 3 is a conceptual diagram showing an example of a solid-state imaging element in which a semiconductor chip of a pixel array section and a semiconductor chip of a peripheral circuit section are stacked. FIG. 4 is a circuit diagram showing an example of the configuration of a pixel circuit according to the first embodiment. FIG. 5 is a diagram showing an example of the configuration of a differentiation circuit. FIG. 6 is a diagram showing an example of the configuration of a differentiation circuit. FIG. 7 is a diagram showing an example of the configuration of a Vref generation circuit that generates a threshold value. FIG. 8 is a timing diagram showing an example of the operation of an imaging device according to the first embodiment. FIG. 9 is a timing diagram showing an example of the operation of an imaging device according to a second embodiment. FIG. 10 is a timing diagram showing an example of the operation of an imaging device according to a third embodiment. FIG. 11 is a plan view showing an example of the layout position of a tilt detection circuit. FIG. 12 is a block diagram showing an example of the schematic configuration of a vehicle control system. FIG. 13 is an explanatory diagram showing an example of the installation positions of an outside vehicle information detection unit and an imaging unit.

[0022] Hereinafter, specific embodiments to which the present technology is applied will be described in detail with reference to the drawings. The drawings are schematic or conceptual, and the proportions of each part are not necessarily the same as those in reality. In the specification and drawings, elements similar to those described above with reference to the previous drawings are designated by the same reference numerals, and detailed descriptions thereof will be omitted as appropriate.

[0023] 1 is a block diagram showing an example of the configuration of an imaging device 100 according to the first embodiment. The imaging device 100 is a device for capturing an image of a subject and generating image data thereof, and includes an optical unit 110, a solid-state imaging element 200, and a DSP (Digital Signal Processing) circuit 120. The imaging device 100 further includes a display unit 130, an operation unit 140, a bus 150, a frame memory 160, a storage unit 170, and a power supply unit 180. The imaging device 100 may be a camera mounted on a smartphone, an in-vehicle camera, or the like.

[0024] The optical unit 110 collects light from a subject and guides it to the solid-state imaging element 200. The solid-state imaging element 200 generates image data by photoelectric conversion. The solid-state imaging element 200 supplies the generated image data to the DSP circuit 120 via a signal line 209.

[0025] The DSP circuit 120 performs predetermined signal processing on the image data and outputs the processed image data to a frame memory 160 or the like via a bus 150.

[0026] The display unit 130 displays image data. For example, a liquid crystal panel or an organic EL (Electro Luminescence) panel is assumed as the display unit 130. The operation unit 140 generates an operation signal in accordance with a user's operation.

[0027] The bus 150 is a common path for the optical unit 110, solid-state image sensor 200, DSP circuit 120, display unit 130, operation unit 140, frame memory 160, storage unit 170, and power supply unit 180 to exchange data with one another.

[0028] The frame memory 160 holds image data. The storage unit 170 stores various data such as image data. The power supply unit 180 supplies power to the solid-state imaging device 200, the DSP circuit 120, the display unit 130, and the like.

[0029] 2 is a block diagram showing an example of the configuration of a solid-state imaging device 200 according to the first embodiment. The solid-state imaging device 200 includes a vertical scanning circuit 210, a timing control unit 220, a DAC (Digital to Analog Converter) 231, a pixel array unit 240, a column signal processing unit 260, a horizontal scanning circuit 270, and a tilt detection circuit SD.

[0030] A plurality of pixel circuits 250 are arranged in a two-dimensional lattice in the pixel array section 240. Hereinafter, a set of pixel circuits 250 arranged in a predetermined horizontal direction will be referred to as a "pixel row," and a set of pixel circuits 250 arranged in a vertical direction in the pixel row will be referred to as a "pixel column."

[0031] The vertical scanning circuit 210 sequentially drives the pixel rows to cause the pixel circuits 250 to output signals.

[0032] The timing control unit 220 synchronizes with the vertical synchronization signal VSYNC to control the operation timing of each of the vertical scanning circuit 210, the DAC 231, the column signal processing unit 260, and the horizontal scanning circuit 270. The vertical synchronization signal VSYNC is a periodic signal of a predetermined frequency (e.g., 60 Hz) that indicates the imaging timing.

[0033] The DAC 231 generates a reference signal by DA (Digital to Analog) conversion. For example, a sawtooth ramp signal is used as the reference signal. The DAC 231 supplies the reference signal to the column signal processing unit 260. The reference signal is a signal whose voltage changes over time with a predetermined slope, and is used by the column signal processing unit 260 to detect pixel signals.

[0034] The pixel circuit 250 generates an analog pixel signal by photoelectric conversion and supplies the signal to the column signal processing unit 260 .

[0035] The column signal processing unit 260 performs signal processing such as AD (Analog to Digital) conversion processing and CDS (Correlated Double Sampling) processing on pixel signals for each pixel column. The column signal processing unit 260 supplies image data consisting of processed digital signals to the DSP circuit 120 via a signal line 209. The column signal processing unit 260 may also be called an AD conversion unit.

[0036] The horizontal scanning circuit 270 controls the column signal processing unit 260 to output the digital signals in sequence.

[0037] The slope detection circuit SD differentiates the voltage of the pixel signal to detect its slope, and outputs the slope of the voltage of the pixel signal to the column signal processing unit 260. A more detailed configuration of the slope detection circuit SD will be described later.

[0038] 2 may be configured as a single semiconductor chip as a whole, or may be configured as multiple semiconductor chips. When the solid-state imaging device 200 is configured as multiple semiconductor chips, the pixel array section 240 and the peripheral circuit section 15 may be formed as separate semiconductor chips 511 and 512, respectively, and the semiconductor chip 511 of the pixel array section 240 and the semiconductor chip 512 of the peripheral circuit section 15 may be stacked.

[0039] 3 is a conceptual diagram showing an example of a solid-state imaging element 200 in which a semiconductor chip 511 of the pixel array unit 240 and a semiconductor chip 512 of the peripheral circuit unit 15 are stacked. As shown in FIG. 3, the solid-state imaging element 200 is composed of two stacked semiconductor chips 511 and 512.

[0040] The number of stacked semiconductor chips may be three or more. The semiconductor chip 511 includes a pixel array section 240 formed on a semiconductor substrate. The semiconductor chip 512 includes a peripheral circuit section 15 formed on another semiconductor substrate. The pixels of the pixel array section 240 of the semiconductor chip 511 and the elements of the peripheral circuit section 15 of the semiconductor chip 512 may be electrically connected using through electrodes such as TSVs (Through Silicon Vias) provided in the via regions 513 and 514. Furthermore, the semiconductor chips 511 of the pixel array section 240 may be bonded together so that the wiring of the semiconductor chip 511 of the peripheral circuit section 15 contacts the wiring of the semiconductor chip 511 of the pixel array section 240 (Cu-Cu bonding). Furthermore, the pixel array section 240 and part of the peripheral circuit section 15 in FIG. 2 may be configured as one semiconductor chip, and the remaining components may be configured as other semiconductor chips.

[0041] 4 is a circuit diagram showing an example configuration of a pixel circuit 250, a tilt detection circuit SD, and a column signal processing unit 260 according to the first embodiment. The pixel circuit 250 includes a photoelectric conversion element 251, a transfer transistor 252, a reset transistor 253, a floating diffusion layer 254, an amplification transistor 255, and a selection transistor 256. The transfer transistor 252, the reset transistor 253, the floating diffusion layer 254, the amplification transistor 255, and the selection transistor 256 are each configured, for example, by an n-type MOSFET (MOS Field Effect Transistor). In addition, in the pixel array unit 240, a data signal line VSL is wired in the vertical direction for each pixel column.

[0042] The photoelectric conversion element 251 photoelectrically converts incident light to generate a pixel signal corresponding to the intensity of the incident light. The photoelectric conversion element 251 is, for example, a photodiode. The amount of charge generated or lost in the photoelectric conversion element 251 corresponds to the intensity of the incident light. The incident light may include visible light, infrared light, and / or ultraviolet light.

[0043] The transfer transistor 252 is connected between the photoelectric conversion element 251 and the floating diffusion layer 254. A transfer signal TG is supplied to the gate of the transfer transistor 252 from the vertical scanning circuit 210. The transfer transistor 252 is controlled by the transfer signal TG and transfers charges corresponding to a pixel signal to the photoelectric conversion element 251 and the floating diffusion layer 254.

[0044] The reset transistor 253 is connected between the floating diffusion layer 254 and a power supply line to which a power supply voltage VDD is supplied. A reset signal RST is supplied to the gate of the reset transistor 253 from the vertical scanning circuit 210. The reset transistor 253 is controlled by the reset signal RST, and resets the potential Vfd of the floating diffusion layer 254 by the power supply voltage VDD.

[0045] The floating diffusion layer 254 is connected to the gate of the amplification transistor 255. The floating diffusion layer 254 functions as an input node (gate) of the amplification transistor 255. The floating diffusion layer 254 temporarily holds the charge accumulated in the photoelectric conversion element 251, and passes the charge corresponding to the pixel signal to the photoelectric conversion element 251 or receives the charge from the photoelectric conversion element 251. As a result, the floating diffusion layer 254 generates a voltage corresponding to the amount of charge held as the pixel signal. The amplification transistor 255 amplifies the voltage of the floating diffusion layer 254.

[0046] The amplifier transistor 255 and the select transistor 256 are connected in series between the power supply line of the power supply voltage VDD and the data signal line VSL. As a result, the amplifier transistor 255 is connected to the data signal line VSL via the select transistor 256.

[0047] A selection signal SEL from the vertical scanning circuit 210 is supplied to the gate of the selection transistor 256. The selection transistor 256 is controlled by the selection signal SEL and selectively connects the amplification transistor 255 of the pixel circuit 250 to the data signal line VSL. Therefore, when the selection transistor 256 is turned on, the amplification transistor 255 amplifies the potential Vfd of the floating diffusion layer 254 and outputs a voltage corresponding to the potential Vfd to the data signal line VSL as a pixel signal. The data signal line VSL transmits the pixel signal from the pixel circuit 250 to the column signal processing unit 14.

[0048] The gates of the transfer transistor 252, the reset transistor 253, and the selection transistor 256 are commonly connected to the vertical scanning circuit 210 for each pixel row, so that the vertical scanning circuit 210 can simultaneously drive a plurality of pixel circuits 250 included in one pixel row.

[0049] Note that the pixel circuit 250 is not limited to the circuit illustrated in the figure, as long as it can generate a pixel signal by photoelectric conversion.

[0050] The data signal line VSL is connected to a constant current circuit LM. The constant current circuit LM is configured to pass a constant current through the data signal line VSL. For example, a MOSFET is used for the constant current circuit LM. When the constant current circuit LM passes a constant current through the data signal line VSL, the amplification transistor 255 transmits a pixel signal having a voltage corresponding to the potential of the floating diffusion layer 254 to the data signal line VSL.

[0051] The column signal processing unit 260 receives pixel signals from the pixel circuits 250 via the data signal lines VSL and performs AD conversion of the pixel signals. The column signal processing unit 260 includes a comparator CM, a counter CN, and capacitors Cvsl and Crmp. The comparator CM, counter CN, and capacitors Cvsl and Crmp are provided for each data signal line VSL, i.e., for each pixel column. Therefore, multiple pixel circuits 250 included in one pixel column share the comparator CM, counter CN, and capacitors Cvsl and Crmp corresponding to that pixel column.

[0052] A first input terminal of the comparator CM is connected to the data signal line VSL via a capacitor Cvsl and receives the pixel signal. A second input terminal of the comparator CM is connected to the DAC 231 shown in FIG. 2 via a capacitor Crmp and receives the reference signal RMP. An output terminal of the comparator CM is connected to a counter CN and outputs the comparison result between the pixel signal voltage Vvsl and the reference signal RMP voltage Vrmp as an output signal Vco. The capacitors Cvsl and Crmp are provided to realize an auto-zero function that cancels out element variations in the comparator.

[0053] The DAC 231 linearly changes the voltage Vrmp of the reference signal RMP with a predetermined slope. That is, the reference signal RMP is a ramp signal with a predetermined slope. The comparator CM inverts the output signal Vco when the voltage Vrmp of the reference signal RMP crosses the voltage Vvsl of the pixel signal. The counter CN counts clock signals during the period from the start of the slope of the reference signal RMP to the inversion of the output signal Vco, thereby measuring that period. As a result, the column signal processing unit 260 performs AD conversion of the pixel signal and generates a digital value corresponding to the pixel signal.

[0054] The slope detection circuit SD is connected between the data signal line VSL and the counter CN of the column signal processing unit 260. The slope detection circuit SD includes a differentiation circuit DC, a comparator CM2, and a switching element SWsd. A slope detection circuit SD is provided for each data signal line VSL, i.e., for each pixel column.

[0055] The switching element SWsd is connected between the data signal line VSL and the differentiation circuit DC. The switching element SWsd is, for example, an n-type MOSFET. Alternatively, the switching element SWsd may be, for example, a p-type MOSFET. The switching element SWsd is controlled by the timing control unit 220 to be on (conductive) or off (non-conductive).

[0056] The input terminal of the differentiation circuit DC is connected to the data signal line VSL via the switching element SWsd. The output terminal of the differentiation circuit DC is connected to the first input terminal of the comparator CM2. The differentiation circuit DC performs time differentiation (dVvsl / dt) of the voltage Vvsl of the pixel signal obtained via the switching element SWsd to calculate a slope Vvsl_dc of the voltage Vvsl. The differentiation circuit DC outputs the slope Vvsl_dc as the differentiation result to the first input terminal of the comparator CM2. The configuration of the differentiation circuit DC is not particularly limited, but will be described later in an embodiment.

[0057] The comparator CM2 is provided between the differentiating circuit DC and the column signal processing unit 260. The first input terminal of the comparator CM2 is connected to the output terminal of the differentiating circuit DC and receives the slope Vvsl_dc. The second input terminal of the comparator CM2 receives the threshold Vref. The output terminal of the comparator CM2 is connected to the counter CN. The comparator CM2 compares the slope Vvsl_dc with the threshold Vref and outputs the result as a slope detection signal Vdet. The threshold Vref is not a ramp signal with a slope but a signal set to a constant value. If the absolute value of the slope Vvsl_dc is greater than or equal to the absolute value of the threshold Vref, the comparator CM2 inverts the slope detection signal Vdet. For example, the comparator CM2 activates the slope detection signal Vdet from a low level to a high level. When the absolute value of the slope Vvsl_dc is smaller than the absolute value of the threshold Vref, the comparator CM2 maintains the slope detection signal Vdet at low level and in an inactive state.

[0058] When detecting the voltage level of a pixel signal in a reset state (hereinafter also referred to as a reset level) that does not include incident light data, if the tilt detection signal Vdet is activated to a high level, the counter CN sets the count value of the pixel signal to the maximum value (full code). As a result, if the intensity of incident light is high and charge is leaking between the floating diffusion layer 25 and the photoelectric conversion element 251 when the reset level is detected, the column signal processing unit 260 can set the digital value corresponding to the pixel signal to the maximum value (full code) and the brightness of the pixel to the maximum value (white).

[0059] 5 and 6 are diagrams showing configuration examples of the differentiation circuit DC. Fig. 5 is an example of a passive differentiation circuit, and Fig. 6 is an example of an active differentiation circuit. The differentiation circuit DC may have either the configuration shown in Fig. 5 or Fig. 6, and is not limited to these configurations.

[0060] 5 includes a variable capacitance Cv and a variable resistance Rv. The input terminal of the differentiating circuit DC is connected to the data signal line VSL via the switching element SWsd and receives the voltage Vvsl of the pixel signal.

[0061] The variable capacitance Cv is composed of a plurality of capacitance elements Cel and a plurality of switching elements Swel. The plurality of capacitance elements Cel are provided corresponding to the plurality of switching elements Swel. A capacitance element Cel and its corresponding switching element Swel form a pair. One pair of capacitance element Cel and switching element Swel is connected in series between the input terminal and output terminal of the differentiation circuit DC. Multiple pairs are connected in parallel between the input terminal and output terminal of the differentiation circuit DC. Note that one capacitance element Cel may be connected between the input terminal and output terminal of the differentiation circuit DC without going through a switching element Swel.

[0062] By turning on / off the switching element SWel, it is possible to control the number of capacitance elements Cel connected in parallel between the input terminal and the output terminal of the differentiation circuit DC, thereby changing the capacitance value of the variable capacitor Cv.

[0063] The variable resistor Rv is connected between the output terminal of the differentiating circuit DC and the power supply line of the offset voltage Voft. The variable resistor Rv is, for example, configured with an n-type MOSFET. The variable resistor Rv may also be configured with a p-type MOSFET. The gate of the variable resistor Rv is controlled by receiving a voltage Vb. The resistance value of the variable resistor Rv changes by changing the voltage Vb. Because the differential value of the voltage Vvsl during AD conversion is a value below 0, the offset voltage Voft is set to a value above Vref so that the slope detection signal Vdet is inverted in the event of leakage.

[0064] As a result, when the capacitance value of the variable capacitor Cv is C and the resistance value of the variable resistor Rv is R, the differentiating circuit DC calculates Vvsl_dc by calculating Equation 1. The differentiating circuit DC is a passive type differentiating circuit with a gain of R×C.

[0065] The differentiating circuit DC in Fig. 6 includes a variable capacitance Cv, a variable resistance Rv, and an operational amplifier Av. The configurations of the variable capacitance Cv and the variable resistance Rv may be the same as those in Fig. 5.

[0066] The operational amplifier Av is connected between the variable capacitor Cv and the output terminal of the differentiating circuit DC. The variable resistor Rv is connected between the input terminal of the operational amplifier Av connected to the variable capacitor Cv and the output terminal of the operational amplifier Av.

[0067] As a result, when the capacitance value of the variable capacitor Cv is C and the resistance value of the variable resistor Rv is R, the differentiating circuit DC calculates Vvsl_dc by calculating the above equation 1. The differentiating circuit DC is an active differentiating circuit with a gain of R×C.

[0068] 5 and 6 separates the data signal line VSL and the comparator CM2 in terms of DC current by a variable capacitance, and therefore does not affect the current flowing through the data signal line VSL between pixel circuits 250 close to the differentiating circuit DC and pixel circuits 250 far from the differentiating circuit DC.

[0069] FIG. 7 is a diagram showing an example of the configuration of a Vref generation circuit that generates the threshold value Vref.

[0070] The Vref generation circuit includes a plurality of resistance elements Rel, a mirror circuit MRR, a variable current source CSv, and a multiplexer MUX.

[0071] A plurality of resistor elements Rel are connected in series between a power supply line of a power supply voltage VDD and ground GND. Each resistor element Rel is composed of a diode-connected MOSFET. One end of each of the resistor elements Rel is connected to a multiplexer MUX, which divides a voltage between the power supply voltage VDD and ground voltage into a plurality of different voltages and outputs the divided voltages.

[0072] The mirror circuit MRR causes a current corresponding to the current flowing through the variable current source CS to flow through a plurality of resistance elements Rel.

[0073] The variable current source CS supplies different currents to the mirror circuit MRR depending on the setting.

[0074] The multiplexer MUX selectively outputs one of the plurality of voltages generated by the plurality of resistance elements Rel as a threshold value Vref to the second input terminal of the comparator CM2 in FIG.

[0075] This allows the Vref generation circuit to supply various voltages as the threshold Vref to the comparator CM2. The comparator CM2 can change the setting of the threshold Vref to detect the gradient of the voltage Vvsl of the data signal line VSL.

[0076] Next, the operation of the imaging device 100 will be described.

[0077] FIG. 8 is a timing chart showing an example of the operation of the imaging device 100 according to the first embodiment.

[0078] First, between t1 and t2, the vertical scanning circuit 210 raises the reset signal RST. This turns on the reset transistor 253, and the floating diffusion layer 254 is charged to a high-level voltage by the power supply voltage VDD. At this time, the transfer transistor 252 and the selection transistor 256 are in the off state, so the charged state of the floating diffusion layer 254 is maintained. This causes the pixel circuit 250 to enter a reset state.

[0079] At t2, the vertical scanning circuit 210 drops the reset signal RST and raises the selection signal SEL. This turns off the reset transistor 253 and turns on the selection transistor 256. The source of the amplification transistor 255 is electrically connected to the data signal line VSL. At this time, the transfer transistor 252 remains off, so the pixel circuit 250 is maintained in a reset state. Therefore, the gate voltage of the amplification transistor 255 (the voltage of the floating diffusion layer 254) is maintained at a high level voltage, and the amplification transistor 255 transmits a high level voltage based on the power supply voltage VDD to the data signal line VSL. Therefore, even if incident light is incident on the pixel circuit 250, the voltage Vvsl of the data signal line VSL is maintained at a relatively high level voltage.

[0080] Here, in the reset state, the transfer transistor 252 remains off, and therefore the charge in the floating diffusion layer 254 is maintained, so that the reset level voltage Vvsl should be maintained at a relatively high level, as shown by the solid line in FIG.

[0081] However, when the intensity of incident light is high, as shown in Figure 4, the charge Ipd may leak from the floating diffusion layer 254 to the photoelectric conversion element 251 via the transfer transistor 252. In this case, the potential of the floating diffusion layer 254 gradually changes, causing the conduction state of the amplification transistor 255 to change. Therefore, as shown by the dashed line in Figure 8, the voltage Vvsl of the reset level pixel signal gradually decreases and has a slope. This causes a white image to become somewhat black, despite the high intensity of incident light.

[0082] Therefore, in this embodiment, after the selection signal SEL rises at t2, the switching element SWsd is turned on during the period (t4 to t5) during which the pixel signal at the reset level is detected. This electrically connects the slope detection circuit SD between the data signal line VSL and the counter CN. In the slope detection circuit SD, the differentiation circuit DC time-differentiates (dVvsl / dt) the voltage Vvsl of the pixel signal to calculate the slope Vvsl_dc of the voltage Vvsl.

[0083] The comparator CM2 compares the slope Vvsl_dc of the voltage Vvsl with a threshold Vref, and outputs the result as a slope detection signal Vdet.

[0084] For example, when the intensity of incident light is not very high, almost no charge leaks from the floating diffusion layer 254 to the photoelectric conversion element 251. In this case, as shown by the solid line in FIG. 8 , the voltage Vvsl is almost flat and has almost no slope. Therefore, the absolute value of the slope Vvsl_dc is less than the absolute value of the threshold Vref, so the comparator CM2 maintains the slope detection signal Vdet at a low level and in an inactive state. In this case, the counter CN of the column signal processing unit 26 counts clock pulses during the period from time t3 when the slope of the voltage Vrmp of the reference signal RMP begins to time t6 when the voltage Vrmp intersects with the voltage Vvsl, and outputs the count value. This allows the column signal processing unit 260 to AD-convert the pixel signal at the reset level into a digital value.

[0085] On the other hand, for example, if the intensity of incident light is very high and charge leaks from the floating diffusion layer 254 to the photoelectric conversion element 251, the voltage Vvsl will have a slope, as shown by the dashed line in FIG. 8 . In this case, the voltage Vvsl of the reset level pixel signal gradually decreases from its normal value. In such a case, if the column signal processing unit 260 performs normal AD conversion of the reset level pixel signal, the digital value of the reset level will be larger than its original value. This is because the voltage Vvsl gradually decreases due to charge leakage, lengthening the period from when the voltage Vrmp of the reference signal RMP starts to slope to when the voltage Vrmp intersects with the voltage Vvsl. Therefore, if the CDS (correlated double sampling) method is used to subtract such a digital value of the reset level from the digital value of the signal level, the image will be blackened. The signal level refers to the level of the voltage Vvsl of the pixel signal containing incident light data (corresponding to the intensity of the incident light).

[0086] In contrast, in the present disclosure, when the intensity of incident light is high and the absolute value of the slope Vvsl_dc of the voltage Vvsl is equal to or greater than the absolute value of the threshold Vref, the comparator CM2 activates the slope detection signal Vdet to a high level. In this case, the counter CN sets the count value to its maximum value. The column signal processing unit 260 receives the maximum count value and outputs the pixel signal after CDS processing as a full-code digital value. Therefore, the image becomes white with maximum brightness, accurately representing the intensity of the incident light. In this case, the AD conversion of the signal level after t5 may be omitted. Because the operations after t5 can be omitted, the frame rate can also be shortened.

[0087] As shown by the solid line in FIG. 8, when the absolute value of the gradient Vvsl_dc is less than the absolute value of the threshold Vref, the AD conversion process proceeds as follows.

[0088] At t5, the switching element SWsd is turned off. This electrically isolates the slope detection circuit SD from the data signal line VSL. The switching element SWsd is turned on during the reset level detection period (t4 to t5) and is otherwise off. This prevents the slope detection signal Vdet from being erroneously activated during the reset period, etc.

[0089] At t6, the voltage Vrmp of the reference signal RMP crosses the voltage Vvsl, and at t7, the operation of the reference signal Vrmp is stopped. The counter CN outputs the count value of the pixel signal at the reset level.

[0090] At t8, the reference signal RMP is reset.

[0091] Between t9 and t10, the vertical scanning circuit 210 lowers the selection signal SEL to turn off the selection transistor 256. The vertical scanning circuit 210 also raises the transfer signal TG to turn on the transfer transistor 252. As a result, charges corresponding to the intensity of the incident light flow from the floating diffusion layer 254 to the photoelectric conversion element 251 via the transfer transistor 252, and the potential of the floating diffusion layer 254 becomes a potential corresponding to the intensity of the incident light.

[0092] At t10, the vertical scanning circuit 210 lowers the transfer signal TG to turn off the transfer transistor 252. This electrically isolates the floating diffusion layer 254 from the photoelectric conversion element 251. The vertical scanning circuit 210 also raises the selection signal SEL to turn on the selection transistor 256. This electrically connects the source of the amplification transistor 255 to the data signal line VSL.

[0093] At this time, the gate voltage of the amplifier transistor 255 (the voltage of the floating diffusion layer 254) is set to a potential corresponding to the intensity of the incident light, and the amplifier transistor 255 transmits a pixel signal of the signal level to the data signal line VSL.

[0094] At t11, the DAC 231 starts the operation of the reference signal RMP. The comparator CM compares the voltage Vrmp of the reference signal RMP with the voltage Vvsl of the pixel signal, and outputs the output signal Vco as the comparison result. At t12, when the voltage Vrmp intersects with the voltage Vvsl of the pixel signal, the comparator CM inverts the logic of the output signal Vco.

[0095] The counter CN counts clock pulses and outputs the count value during the period from time t11 when the reference signal Vrmp starts to ramp to time t12 when the logic of the output signal Vco is inverted (when the voltage Vrmp crosses the voltage Vvsl). This allows the column signal processing unit 260 to AD-convert the pixel signals of the signal levels into digital values.

[0096] The column signal processing unit 260 can subtract the digital value of the reset level from the digital value of the signal level using the CDS (Correlated Double Sampling) method to calculate an accurate digital value of the pixel signal excluding the dark current component.

[0097] According to the present disclosure, the differentiation circuit DC time-differentiates the voltage Vvsl of the pixel signal at the reset level to calculate the slope Vvsl_dc of the voltage Vvsl. The comparator CM2 compares the resulting slope Vvsl_dc with a threshold Vref. When the absolute value of the slope Vvsl_dc is equal to or greater than the absolute value of the threshold Vref, the comparator CM2 activates the slope detection signal Vdet to a high level. In this case, the counter CN sets its count value to its maximum value. In this case, the column signal processing unit 260 outputs the digital value of the pixel signal after CDS processing at its maximum value (full code). This allows the image corresponding to the pixel circuit 100 to be displayed in white with maximum brightness (blown-out highlights), accurately representing the intensity of incident light. This effect is more pronounced for pixel circuits 250 with a higher saturation charge (Qs). Furthermore, in this case, the AD conversion operation of the signal level after t5 can be omitted, thereby shortening the frame rate.

[0098] As a comparative example, a method can be considered in which the current value of the constant current circuit LM is reduced so that the reference signal RMP does not reach the signal level when the intensity of incident light is high. However, reducing the current value of the constant current circuit LM increases the settling time until the voltage Vvsl stabilizes at the reset level or signal level, and there is also a risk of increasing RTN (random telegraph noise).

[0099] In contrast, in the present disclosure, the image is overexposed based on the slope Vvsl_dc of the voltage Vvsl. Therefore, there is no need to reduce the current value of the constant current circuit LM. As a result, in the present disclosure, the settling time of the voltage Vvsl is not lengthened and the RTN is not increased.

[0100] Incidentally, a slope detection circuit SD may be provided for each data signal line VSL (for each pixel column). However, the slope detection circuits SD may also be provided for data signal lines VSL that are intermittently selected from all the data signal lines VSL. That is, the slope detection circuits SD may be thinned out relative to the data signal lines VSL. The slope detection circuits SD hardly change the current flowing through the data signal lines VSL. Therefore, the slope of the reset level voltage Vvsl remains almost constant during AD conversion. This allows the slope detection circuits SD to accurately detect the slope even when thinned out.

[0101] 9 is a timing chart showing an example of the operation of the imaging device 100 according to the second embodiment. In the second embodiment, when the reset level voltage Vvsl does not slope above the threshold, the switching element SWsd is turned on not only during AD conversion of the reset level but also during AD conversion of the signal level. The configuration of the second embodiment may be the same as that of the first embodiment.

[0102] 9, the operation from t1 to t11 may be the same as the operation from t1 to t11 shown in Fig. 8. When the reset level voltage Vvsl is inclined to or above the threshold, the operation of the imaging device 100 is the same as the operation in the first embodiment. On the other hand, when the reset level voltage Vvsl is not inclined to or above the threshold, the switching element SWsd is turned on from t11-1 to t11_2 during the AD conversion operation of the signal level.

[0103] The period from t11 to t12 is a period during which the pixel signal of the signal level is converted into a digital value, and during this AD conversion, the switching element SWsd is turned on.

[0104] The length of the period from t11 to t11-1 is approximately equal to the length of the period from t3 to t4. That is, the switching element SWsd becomes conductive at t4, when the period from t3 to t4 (first period) has elapsed since AD ​​conversion of the reset level began (i.e., from the start of the slope of the reference signal Vrmp). Furthermore, the switching element SWsd becomes conductive at t11_1, when the first period (t11_1 to t11_2) equivalent to t3 to t4 has elapsed since AD ​​conversion of the signal level began (i.e., from the start of the slope of the reference signal Vrmp).

[0105] If the switching element SWsd is turned on only during AD conversion of the pixel signal at the reset level, there is a risk that noise such as streaking will occur in the pixel signal of the data signal line VSL due to the instantaneous current flowing through the slope detection circuit SD.

[0106] In contrast, according to the second embodiment, the switching element SWsd is turned on during the periods (t3 to t4 and t11_1 to t11_2) corresponding to the AD conversion of the reset level pixel signal and the AD conversion of the signal level pixel signal. As a result, noise such as streaking is canceled by CDS processing of the reset level digital value and the signal level digital value in the column signal processing unit 260. As a result, it is possible to obtain a digital value of the pixel signal with less noise.

[0107] Other operations of the second embodiment may be the same as those of the first embodiment, and therefore the second embodiment can also obtain the effects of the first embodiment.

[0108] 10 is a timing chart showing an example of the operation of an imaging device 100 according to a third embodiment. In the third embodiment, a tilt detection circuit SD is provided in common for a plurality of data signal lines VSL (i.e., a plurality of pixel columns). In this case, the tilt detection circuit SD is connected between the plurality of data signal lines VSL and a plurality of column signal processing units 260 corresponding to the plurality of data signal lines VSL.

[0109] The slope detection circuit SD according to the third embodiment includes a first switching element group SWsdi, a second switching element group SWsdo, a differentiation circuit DC, and a comparator CM2. The differentiation circuit DC and the comparator CM2 may have the same configurations as those in the first embodiment.

[0110] The first switching element group SWsdi includes a plurality of first switching elements SWi0 to SWin (n is an integer equal to or greater than 1). The first switching elements SWi0 to SWin are provided corresponding to the plurality of data signal lines VSL (i.e., pixel columns), respectively, and are connected between the corresponding data signal line VSL and the differentiation circuit DC.

[0111] The second switching element group SWsdo includes a plurality of second switching elements SWo0 to SWon, which are provided corresponding to the respective data signal lines VSL (i.e., pixel columns) and connected between the corresponding column signal processor 260 and the comparator CM2.

[0112] The first and second switching elements SWi0 to SWin and SWo0 to SWon may each be configured with a MOSFET.

[0113] The first switching element SWik (k=0 to n) and the second switching element SWok corresponding to one data signal line VSL selected from the first switching elements SWi0 to SWin are turned on. The other first switching elements SWi0 to SWik, SWik+1 to SWin and the second switching elements SWo0 to SWok, SWok+1 to SWon are maintained in the off state. As a result, the slope detection circuit SD is selectively electrically connected between the selected data signal line VSL and the counter CN of the column signal processing unit 260 corresponding to that data signal line VSL. The slope detection circuit SD detects the slope of the pixel signal from the selected data signal line VSL.

[0114] Other configurations of the third embodiment may be the same as those of the first or second embodiment. According to the third embodiment, the tilt detection circuits SD are provided corresponding to the plurality of data signal lines VSL, which reduces the circuit scale of the imaging device 100 and the layout area.

[0115] 11 is a timing chart showing an example of the operation of the imaging device 100 according to the third embodiment. In the third embodiment, pairs of first and second switching elements SWik and SWok corresponding to multiple data signal lines VSL are sequentially turned on during one ramp operation of the reference signal Vrmp.

[0116] For example, after the ramp of the reference signal Vrmp starts at t3, the pair of first and second switching elements SWi0 and SWo0 is turned on at t4, and then the pair of first and second switching elements SWi0 and SWo0 is turned off at t5. Next, the pair of first and second switching elements SWi1 and SWo1 is turned on and then off. Next, the pair of first and second switching elements SWi2 and SWo2 is turned on and then off. This process is repeated to sequentially turn on and off the pair of first and second switching elements SWik and SWok.

[0117] As a result, the slope detection circuit SD can detect the slope of the reset level of the data signal lines VSL of a plurality of columns in one slope operation of the reference signal Vrmp during AD conversion of the reset level.

[0118] Furthermore, during AD conversion of the signal level, the pair of first and second switching elements SWik and SWok is sequentially turned on and off during one ramp of the reference signal Vrmp. The period from the start of the ramp of the reference signal Vrmp to the on and off of the first and second switching elements SWik and SWok is set equal for AD conversion of the reset level and AD conversion of the signal level. As a result, even in the third embodiment, the settling time of the voltage Vvsl does not become long, and RTN does not increase.

[0119] Furthermore, since the slope detection circuit SD is provided in common for a plurality of data signal lines VSL, power consumption can be reduced.

[0120] Other operations of the third embodiment may be similar to those of the first or second embodiment, and therefore the third embodiment can achieve the same effects as the first or second embodiment.

[0121] The slope detection circuit SD may detect the slope of the reset level voltage Vvsl for all data signal lines VSL. However, the slope detection circuit SD may also detect the slope of the reset level voltage Vvsl for data signal lines VSL intermittently selected from all data signal lines VSL. The slope detection circuit SD hardly changes the current flowing through the data signal line VSL. Therefore, the slope of the reset level voltage Vvsl remains almost constant during AD conversion. This allows the slope detection circuit SD to accurately detect the slope of the voltage Vvsl for intermittently selected data signal lines VSL.

[0122] When detecting the gradient of the voltage Vvsl for the intermittently selected data signal lines VSL, the first and second switching elements SWi0 to SWin and SWo0 to SWon may be provided corresponding to each of the n data signal lines VSL. However, the first and second switching elements SWi0 to SWin and SWo0 to SWon may be provided corresponding to the data signal lines VSL that are intermittently selected out of all the data signal lines VSL, and the others may be omitted.

[0123] 12 is a plan view showing an example of the layout position of the tilt detection circuit SD. If the tilt detection circuit SD is closer to the pixel array unit 240 than the constant current circuit LM, the wiring from the constant current circuit LM to the pixel array unit 240 becomes longer. In this case, the wiring resistance from the constant current circuit LM to the pixel circuit 250 increases.

[0124] Therefore, the slope detection circuit SD is placed at a position farther from the pixel array unit 240 than the constant current circuit LM. For example, the slope detection circuit SD is placed between the constant current circuit LM and the comparator CM of the column signal processing unit 260. This makes it possible to suppress an increase in the wiring resistance from the constant current circuit LM to the pixel circuit 250.

[0125] (Application Example to a Mobile Body) The technology according to the present disclosure (the present technology) can be applied to various products. For example, the technology according to the present disclosure may be realized as a device mounted on any type of mobile body, such as an automobile, an electric vehicle, a hybrid electric vehicle, a motorcycle, a bicycle, personal mobility, an airplane, a drone, a ship, or a robot.

[0126] FIG. 13 is a block diagram showing a schematic configuration example of a vehicle control system, which is an example of a mobile object control system to which the technology according to the present disclosure can be applied.

[0127] The vehicle control system 12000 includes a plurality of electronic control units connected via a communication network 12001. In the example shown in Fig. 13, the vehicle control system 12000 includes a drive system control unit 12010, a body system control unit 12020, an outside-vehicle information detection unit 12030, an inside-vehicle information detection unit 12040, and an integrated control unit 12050. Also shown in the figure are a microcomputer 12051, an audio / video output unit 12052, and an in-vehicle network I / F (Interface) 12053 as functional components of the integrated control unit 12050.

[0128] The drivetrain control unit 12010 controls the operation of devices related to the drivetrain of the vehicle in accordance with various programs. For example, the drivetrain control unit 12010 functions as a control device for a drive force generating device for generating a drive force of the vehicle, such as an internal combustion engine or a drive motor, a drive force transmission mechanism for transmitting the drive force to the wheels, a steering mechanism for adjusting the steering angle of the vehicle, and a braking device for generating a braking force of the vehicle.

[0129] The body system control unit 12020 controls the operation of various devices equipped in the vehicle body according to various programs. For example, the body system control unit 12020 functions as a control device for a keyless entry system, a smart key system, a power window device, or various lamps such as headlamps, backup lamps, brake lamps, turn signals, and fog lamps. In this case, radio waves transmitted from a portable device that serves as a key or signals from various switches can be input to the body system control unit 12020. The body system control unit 12020 receives these radio waves or signals and controls the vehicle's door lock device, power window device, lamps, etc.

[0130] The outside-vehicle information detection unit 12030 detects information outside the vehicle equipped with the vehicle control system 12000. For example, an imaging unit 12031 is connected to the outside-vehicle information detection unit 12030. The outside-vehicle information detection unit 12030 causes the imaging unit 12031 to capture images outside the vehicle and receives the captured images. The outside-vehicle information detection unit 12030 may perform object detection processing or distance detection processing for people, cars, obstacles, signs, characters on the road surface, etc. based on the received images.

[0131] The imaging unit 12031 is an optical sensor that receives light and outputs an electrical signal corresponding to the amount of light received. The imaging unit 12031 can output the electrical signal as an image or as distance measurement information. The light received by the imaging unit 12031 may be visible light or invisible light such as infrared light.

[0132] The in-vehicle information detection unit 12040 detects information inside the vehicle. For example, a driver state detection unit 12041 that detects the state of the driver is connected to the in-vehicle information detection unit 12040. The driver state detection unit 12041 includes, for example, a camera that captures an image of the driver, and the in-vehicle information detection unit 12040 may calculate the degree of fatigue or concentration of the driver based on the detection information input from the driver state detection unit 12041, or may determine whether the driver is dozing off.

[0133] The microcomputer 12051 can calculate control target values ​​for the driving force generating device, steering mechanism, or braking device based on the information inside and outside the vehicle acquired by the outside-vehicle information detection unit 12030 or the inside-vehicle information detection unit 12040, and output control commands to the drive system control unit 12010. For example, the microcomputer 12051 can perform cooperative control aimed at realizing the functions of an ADAS (Advanced Driver Assistance System), including vehicle collision avoidance or impact mitigation, following driving based on the distance between vehicles, maintaining vehicle speed, vehicle collision warning, vehicle lane departure warning, etc.

[0134] In addition, the microcomputer 12051 can perform cooperative control for the purpose of autonomous driving, which allows the vehicle to travel autonomously without relying on driver operation, by controlling the driving force generating device, steering mechanism, braking device, etc. based on information about the surroundings of the vehicle obtained by the outside vehicle information detection unit 12030 or the inside vehicle information detection unit 12040.

[0135] Furthermore, the microcomputer 12051 can output a control command to the body system control unit 12030 based on the information outside the vehicle acquired by the outside information detection unit 12030. For example, the microcomputer 12051 can control the headlamps according to the position of a preceding vehicle or an oncoming vehicle detected by the outside information detection unit 12030, and perform cooperative control aimed at preventing glare, such as switching from high beams to low beams.

[0136] The audio / video output unit 12052 transmits at least one of audio and video output signals to an output device capable of visually or audibly notifying information to vehicle occupants or the outside of the vehicle. In the example of Fig. 13, the output devices are exemplified by an audio speaker 12061, a display unit 12062, and an instrument panel 12063. The display unit 12062 may include, for example, at least one of an on-board display and a head-up display.

[0137] FIG. 14 is a diagram showing an example of the installation position of the imaging unit 12031.

[0138] In FIG. 14, the imaging unit 12031 includes imaging units 12101, 12102, 12103, 12104, and 12105.

[0139] The imaging units 12101, 12102, 12103, 12104, and 12105 are provided, for example, at positions such as the front nose, side mirrors, rear bumper, back door, and the top of the windshield inside the vehicle cabin of the vehicle 12100. The imaging unit 12101 provided on the front nose and the imaging unit 12105 provided on the top of the windshield inside the vehicle cabin mainly acquire images of the front of the vehicle 12100. The imaging units 12102 and 12103 provided on the side mirrors mainly acquire images of the sides of the vehicle 12100. The imaging unit 12104 provided on the rear bumper or back door mainly acquires images of the rear of the vehicle 12100. The imaging unit 12105 provided on the top of the windshield inside the vehicle cabin is mainly used to detect preceding vehicles, pedestrians, obstacles, traffic lights, traffic signs, lanes, etc.

[0140] 14 shows an example of the imaging ranges of the imaging units 12101 to 12104. Imaging range 12111 indicates the imaging range of the imaging unit 12101 provided on the front nose, imaging ranges 12112 and 12113 indicate the imaging ranges of the imaging units 12102 and 12103 provided on the side mirrors, respectively, and imaging range 12114 indicates the imaging range of the imaging unit 12104 provided on the rear bumper or back door. For example, by overlaying the image data captured by the imaging units 12101 to 12104, an overhead image of the vehicle 12100 viewed from above can be obtained.

[0141] At least one of the image capturing units 12101 to 12104 may have a function of acquiring distance information. For example, at least one of the image capturing units 12101 to 12104 may be a stereo camera made up of multiple image capturing elements, or may be an image capturing element having pixels for phase difference detection.

[0142] For example, based on the distance information obtained from the imaging units 12101 to 12104, the microcomputer 12051 can calculate the distance to each three-dimensional object within the imaging ranges 12111 to 12114 and the change in this distance over time (relative speed with respect to the vehicle 12100), thereby extracting as a preceding vehicle, in particular, the three-dimensional object that is the closest three-dimensional object on the path of the vehicle 12100 and traveling in approximately the same direction as the vehicle 12100 at a predetermined speed (e.g., 0 km / h or higher). Furthermore, the microcomputer 12051 can set a vehicle-to-vehicle distance to be maintained in advance in front of the preceding vehicle, and perform automatic braking control (including follow-up stop control), automatic acceleration control (including follow-up start control), etc. In this way, cooperative control can be performed for the purpose of autonomous driving, which allows the vehicle to travel autonomously without relying on driver operation.

[0143] For example, the microcomputer 12051 classifies and extracts three-dimensional object data regarding three-dimensional objects into two-wheeled vehicles, ordinary vehicles, large vehicles, pedestrians, utility poles, and other three-dimensional objects based on distance information obtained from the imaging units 12101 to 12104, and can use the data for automatic obstacle avoidance. For example, the microcomputer 12051 distinguishes obstacles around the vehicle 12100 into obstacles that are visible to the driver of the vehicle 12100 and obstacles that are difficult to see. The microcomputer 12051 then determines a collision risk that indicates the risk of collision with each obstacle, and when the collision risk is equal to or greater than a set value and a collision is possible, the microcomputer 12051 can provide driving assistance for collision avoidance by outputting an alarm to the driver via the audio speaker 12061 or the display unit 12062, or by performing forced deceleration or avoidance steering via the drive system control unit 12010.

[0144] At least one of the image capturing units 12101 to 12104 may be an infrared camera that detects infrared rays. For example, the microcomputer 12051 can recognize a pedestrian by determining whether a pedestrian is present in the images captured by the image capturing units 12101 to 12104. Such pedestrian recognition is performed, for example, by extracting feature points from the images captured by the image capturing units 12101 to 12104 as infrared cameras and performing pattern matching on a series of feature points that indicate the outline of an object to determine whether the object is a pedestrian. When the microcomputer 12051 determines that a pedestrian is present in the images captured by the image capturing units 12101 to 12104 and recognizes the pedestrian, the audio / image output unit 12052 controls the display unit 12062 to superimpose a rectangular outline on the recognized pedestrian for emphasis. The audio / image output unit 12052 may also control the display unit 12062 to display an icon or the like indicating the pedestrian at a desired position.

[0145] The above describes an example of a vehicle control system to which the technology according to the present disclosure can be applied. The technology according to the present disclosure can be applied to, for example, the image capturing unit 12031 and the like among the above-described components.

[0146] The present technology may have the following configurations: (1) An imaging device comprising: a pixel unit including a plurality of pixels that generate pixel signals by photoelectrically converting incident light; a first signal line that transmits the pixel signals from the pixel unit; a signal processing unit that converts the pixel signals into digital values; a differentiation circuit that is provided between the first signal line and the signal processing unit and differentiates the pixel signals and outputs the differentiation result; and a first comparison unit that is provided between the differentiation circuit and the signal processing unit and compares the differentiation result with a predetermined threshold and outputs the comparison result to the signal processing unit. (2) The imaging device described in (1), in which the first comparison unit inverts the comparison result when an absolute value of the differentiation result of the pixel signal that does not include data of the incident light is equal to or greater than the absolute value of the threshold. (3) The imaging device described in (2), in which the signal processing unit maximizes the digital value when the first comparison unit inverts the comparison result. (4) The imaging device described in any one of (1) to (3), further comprising a switching element that is provided between the differentiation circuit and the first signal line. (5) The imaging device according to (4), wherein the switching element is in a conductive state during a period in which the pixel signal not including data on the incident light is being converted into the digital value. (6) The imaging device according to any one of (1) to (5), wherein a plurality of the first signal lines are provided, and the differentiation circuit and the first comparison unit are provided for each of the first signal lines. (7) The imaging device according to any one of (1) to (6), wherein a plurality of the first signal lines are provided, and the differentiation circuit and the first comparison unit are provided for a first signal line intermittently selected from the plurality of first signal lines. (8) The imaging device according to any one of (1) to (7), wherein the signal processing unit includes: a second comparison unit that compares the pixel signal with a reference signal whose voltage changes at a predetermined slope and inverts an output when the reference signal crosses the pixel signal; and a counter that counts clock signals during a period from when the reference signal starts to change to when the output of the second comparison unit inverts, and wherein when the first comparison unit inverts the comparison result, the counter maximizes the count value.(9) The imaging device according to (5), wherein the switching element is in a conductive state during a period in which the pixel signal including the incident light data is being converted into the digital value. (10) The imaging device according to (9), wherein the switching element is in a conductive state when a first period has elapsed since the start of digital conversion of the pixel signal not including the incident light data, and is in a conductive state again when the first period has elapsed since the start of digital conversion of the pixel signal including the incident light data. (11) The imaging device according to any one of (1) to (10), wherein a plurality of the first signal lines are provided, and the differentiating circuit and the first comparing unit are provided in common for the plurality of first signal lines. (12) The imaging device according to (11), further comprising: a plurality of first switching elements provided between the differentiating circuit and each of the plurality of first signal lines; and a plurality of second switching elements provided between the first comparing unit and the signal processing unit corresponding to each of the plurality of first signal lines. (13) The imaging device according to (12), wherein the plurality of first switching elements and the plurality of second switching elements are provided corresponding to the plurality of first signal lines, respectively. (14) The imaging device according to (12), wherein the plurality of first switching elements and the plurality of second switching elements are provided corresponding to first signal lines intermittently selected from the plurality of first signal lines. (15) The imaging device according to (8), further comprising a current circuit that causes a current to flow through the first signal lines, wherein the differentiation circuit and the first comparison unit are disposed at positions farther from the pixel unit than the current circuit.

[0147] The present disclosure is not limited to the above-described embodiments, and various modifications are possible within the scope of the gist of the present disclosure. Furthermore, the effects described in this specification are merely examples and are not intended to be limiting, and other effects may also be obtained.

[0148] REFERENCE SIGNS LIST 100 Imaging device 110 Optical section 200 Solid-state imaging element 210 Vertical scanning circuit 220 Timing control section 231 DAC 240 Pixel array section 260 Column signal processing section 270 Horizontal scanning circuit SD Tilt detection circuit DC Differentiation circuit CM2 Comparator SWsd Switching element CM Comparator CN Counter Cvsl, Crmp Capacitor

Claims

1. An imaging device comprising: a pixel section including a plurality of pixels which generate pixel signals by photoelectrically converting incident light; a first signal line which transmits the pixel signals from the pixel section; a signal processing section which converts the pixel signals into digital values; a differentiation circuit provided between the first signal line and the signal processing section, which differentiates the pixel signals and outputs the differentiation result; and a first comparison section provided between the differentiation circuit and the signal processing section, which compares the differentiation result with a predetermined threshold value and outputs the comparison result to the signal processing section.

2. The imaging device according to claim 1, wherein the first comparator inverts the comparison result when the absolute value of the differentiation result of the pixel signal not including the incident light data is equal to or greater than the absolute value of the threshold value.

3. The imaging device according to claim 2, wherein when the first comparator inverts the comparison result, the signal processor sets the digital value to a maximum value.

4. The imaging device according to claim 1, further comprising a switching element provided between the differentiation circuit and the first signal line.

5. The imaging device according to claim 4, wherein the switching element is in a conductive state during a period in which the pixel signal not including data on the incident light is being converted into the digital value.

6. The imaging device according to claim 1, wherein a plurality of said first signal lines are provided, and said differentiation circuit and said first comparison section are provided for each of said first signal lines.

7. An imaging device as described in claim 1, wherein a plurality of the first signal lines are provided, and the differentiation circuit and the first comparison unit are provided on first signal lines intermittently selected from the plurality of first signal lines.

8. The imaging device of claim 1, wherein the signal processing section comprises: a second comparison section that compares the pixel signal with a reference signal whose voltage changes with a predetermined slope, and inverts an output when the reference signal crosses the pixel signal; and a counter that counts clock signals during the period from when the reference signal starts to change to when the output of the second comparison section is inverted, and when the first comparison section inverts the comparison result, the counter sets the count value to a maximum value.

9. The imaging device according to claim 5, wherein the switching element is in a conductive state during a period in which the pixel signal including data on the incident light is being converted into the digital value.

10. The imaging device of claim 9, wherein the switching element becomes conductive when a first period has elapsed since the start of digital conversion of the pixel signal not including data of the incident light, and becomes conductive when the first period has elapsed since the start of digital conversion of the pixel signal including data of the incident light.

11. The imaging device according to claim 1, wherein a plurality of the first signal lines are provided, and the differentiation circuit and the first comparison section are provided in common to the plurality of first signal lines.

12. The imaging device described in claim 11, further comprising: a plurality of first switching elements provided between the differentiation circuit and each of the plurality of first signal lines; and a plurality of second switching elements provided between the first comparison unit and the signal processing unit corresponding to each of the plurality of first signal lines.

13. The imaging device according to claim 12, wherein the plurality of first switching elements and the plurality of second switching elements are provided corresponding to the plurality of first signal lines, respectively.

14. The imaging device according to claim 12, wherein the plurality of first switching elements and the plurality of second switching elements are provided corresponding to first signal lines that are intermittently selected from the plurality of first signal lines.

15. The imaging device according to claim 8, further comprising a current circuit that causes a current to flow through the first signal line, wherein the differentiation circuit and the first comparison section are disposed at a position farther from the pixel section than the current circuit.

Citation Information

Patent Citations

  • Imaging apparatus and imaging method

    JP2022017124A