Solid-state imaging device having difference circuit for frame difference
By designing differential circuits in solid-state imaging devices and combining dual sampling and kTC noise reduction technology, the noise problem in analog pixel signal frame difference is solved, and the image quality is improved, especially under low light conditions.
Patent Information
- Application Number
- CN202380029710.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-03-31
- Filing Date
- 2023-03-07
- Publication Date
- 2024-11-12
AI Technical Summary
The analog pixel signals are susceptible to noise when performing frame differential in solid-state imaging devices, especially under low light conditions, resulting in a degradation of image quality.
A differential circuit configuration is designed, each pixel circuit outputs the previous pixel signal and the new pixel signal within the row selection interval, and obtains the differential signal from the two pixel signals continuously transmitted through the differential circuit, and combines the dual sampling circuit and kTC. Noise reduction circuit to reduce noise impact.
Effectively reduces the impact of noise on image quality and improves image quality, especially in low light conditions, with little additional workload added.
Smart Images

Figure CN118947106A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a solid-state imaging device including a differential circuit for frame differentiation. More particularly, the present disclosure relates to a solid-state imaging device including a differential circuit for frame differentiation based on an analog pixel signal. Background Art
[0002] The image sensor in the solid-state imaging device includes a photoelectric conversion element that generates a photocurrent proportional to the intensity of the received radiation. The pixel circuit converts the small photocurrent generated by the photoelectric conversion element into a voltage signal. The source follower circuit outputs the corresponding pixel signal on the data line within the row selection interval. For intensity readout, the downstream analog-to-digital converter (ADC) converts the pixel signal into a digital pixel value.
[0003] Various frame differencing methods compare successive pixel signals obtained from the same pixel circuit to generate information indicating changes in the imaged scene. Frame differencing helps to quickly detect motion in the imaged scene and quickly estimate motion vectors that describe the speed and direction of moving objects in the imaged scene. Frame differencing can use digital pixel values, where the digital values can be obtained by a double sampling method for noise reduction. Summary of the invention
[0004] Solid-state imaging devices that use analog pixel signals for frame differentiation are subject to noise that can degrade image quality, particularly in low light conditions. The present disclosure alleviates the drawbacks of frame differentiation discussed in the prior art. Specifically, by providing a configuration of differential circuits, various noise reduction techniques can be implemented with little additional work, thereby reducing the impact of noise on image quality.
[0005] To this end, a solid-state imaging device according to the present disclosure includes a pixel circuit, wherein each pixel circuit outputs a pixel signal on a data signal line in response to an activated row selection signal within a row selection interval. Each pixel circuit includes a floating diffusion region, wherein a floating diffusion potential of the floating diffusion region determines a voltage level of the pixel signal. For each pixel circuit, a differential circuit receives two pixel signals continuously transmitted from the pixel circuit on the data signal line within the same row selection interval. The differential circuit obtains a differential signal from the two pixel signals. The solid-state imaging device controls each pixel circuit to output a previous pixel signal and a new pixel signal within the same row selection interval, wherein the previous pixel signal and the new pixel signal contain image information related to imaging scenes at different time points.
[0006] Specifically, components of the differential circuit may also be used in a double sampling circuit for noise reduction and / or may be combined with a kTC noise reduction circuit. BRIEF DESCRIPTION OF THE DRAWINGS
[0007] A more complete appreciation of the present disclosure and many of its attendant advantages will be more readily obtained as the present disclosure becomes better understood by reference to the following detailed description when considered in conjunction with the accompanying drawings, in which:
[0008] Figure 1 is a simplified block diagram showing a solid-state imaging device having a differential circuit and a double sampling circuit for noise reduction according to an embodiment of the present technology.
[0009] Figure 2 is a simplified block diagram showing a solid-state imaging device having a differential circuit and a kTC noise reduction circuit according to an embodiment of the present technology.
[0010] Figure 3 is a simplified block diagram of a portion of an image sensor assembly having a differential circuit and a threshold shift compensation circuit according to another embodiment of the present technology.
[0011] Figure 4 is a simplified block diagram of a portion of an image sensor assembly having differential circuitry and dual sampling circuitry in accordance with another embodiment of the present technology.
[0012] Figure 5 is a simplified block diagram of a portion of an image sensor assembly having a differential circuit including a sampling capacitor, a gain capacitor, and an amplifier circuit in accordance with another embodiment of the present technology.
[0013] Fig. 6A is a simplified block diagram of a portion of an image sensor assembly having a differential circuit including a sampling capacitor, a gain capacitor, and an amplifier circuit, as well as a kTC noise reduction circuit and a 5T pixel circuit according to another embodiment of the present technology.
[0014] Figure 6B yes Fig. 6A A simplified timing diagram of the various internal and output signals of the image sensor component.
[0015] Fig. 7A is a simplified block diagram of a portion of an image sensor assembly having a differential circuit and a 4T pixel circuit including a sampling capacitor, a gain capacitor, and an amplifier circuit in accordance with another embodiment of the present technology.
[0016] Figure 7B yes Fig. 7A A simplified timing diagram of the various internal and output signals of the image sensor component.
[0017] Fig. 8A is a simplified block diagram of a portion of an image sensor assembly having a differential circuit including a fully differential amplifier in accordance with another embodiment of the present technology.
[0018] Figure 8B yes Fig. 8A A simplified timing diagram of the various internal and output signals of the image sensor component.
[0019] Fig. 9A is a simplified block diagram of a portion of an image sensor assembly having a differential circuit and performing noise reduction on a new pixel signal by CDS according to another embodiment of the present technology.
[0020] Fig. 9B yes Fig. 9A A simplified timing diagram of the various internal and output signals of the image sensor component.
[0021] Fig.10 is a simplified block diagram of a portion of an image sensor assembly that combines differential circuitry for denoising new pixel signals via CDS with kTC noise reduction in accordance with another embodiment of the present technology.
[0022] Fig.11 yes Fig.10 A simplified timing diagram of the various internal and output signals of the image sensor component.
[0023] Fig.12 is a simplified block diagram of a converter circuit including a comparator portion in accordance with an embodiment of the present technology.
[0024] Fig.13 is a simplified block diagram of a converter circuit including an AD converter with an adjustable threshold level in accordance with an embodiment of the present technology.
[0025] Fig.14 It is based on Fig.13 A simplified flow chart of a method of a converter circuit.
[0026] Fig.15A is a simplified block diagram of a portion of an image sensor assembly having differential circuitry that outputs a binary differential signal in accordance with an embodiment of the present technology.
[0027] 15B Yes Fig.15A A simplified timing diagram of the various internal and output signals of the image sensor component.
[0028] Fig.16A is a simplified block diagram of a portion of an image sensor assembly having differential circuitry integrated into an AD converter in accordance with an embodiment of the present technology.
[0029] Fig. 16B yes Fig.16A A simplified timing diagram of the various internal and output signals of the image sensor component.
[0030] Fig.17 : is a diagram illustrating an example of a laminated structure of a solid-state imaging device according to an embodiment of the present disclosure.
[0031] Fig.18 is a block diagram showing an example of a schematic configuration of a vehicle control system.
[0032] Fig.19 It is an auxiliary explanation Fig.18 A diagram showing an example of installation positions of an exterior information detection portion and an imaging portion of a vehicle control system. DETAILED DESCRIPTION
[0033] Embodiments for implementing the technology of the present disclosure (hereinafter also referred to as "embodiments") will be described in detail below using the accompanying drawings. The technology of the present disclosure is not limited to the described embodiments, and the various numerical values and the like in the embodiments are merely illustrative. The same elements or elements having the same functions are represented by the same reference numerals. Repeated descriptions are omitted.
[0034] The connected electronic components can be electrically connected by a direct, permanent low resistance connection (e.g., by a wire). The terms "electrically connected" and "signal connected" can also include connections through other electronic components that are provided and suitable for permanent and / or temporary signal transmission and / or energy transmission. For example, the electronic components can be electrically connected or signal connected by resistors, capacitors, and electronic switches (such as transistors or transistor circuits), for example, field effect transistors (FETs), transmission gates, etc. The load path of a transistor is the control path of the transistor. For example, the voltage applied to the gate of a FET controls the current to flow in the load path between the source and the drain through the field effect.
[0035] Although a technique for reducing temporal noise is described below in the context of a particular type of intensity readout image sensor, the technique may also be used for other types of image sensors.
[0036] Figure 1 and Figure 2 A configuration example of a solid-state imaging device 90 including an image sensor assembly 10 and a signal processing unit 80 according to an embodiment of the present technology is shown. The image sensor assembly 10 may include a pixel array unit 11, a row decoder 12, a pixel driving unit 13, a column signal processing unit 14, and a sensor controller 15.
[0037] The pixel array unit 11 includes a plurality of identical pixel circuits 100. The pixel circuit 100 may be any active pixel sensor for intensity readout having at least four field effect transistors (FETs). In the illustrated embodiment, each pixel circuit 100 includes one photoelectric conversion element PD and five FETs for controlling the output signal of the pixel circuit 100. Other embodiments may involve a pixel circuit 100 having more than five FETs, or a pixel circuit 100 having four FETs and two or more photoelectric conversion elements PD.
[0038] The photoelectric conversion elements PD of the pixel array unit 11 may be arranged in columns and rows in a matrix. A subset of the pixel circuits 100 assigned to the same column of the photoelectric conversion elements PD may form pixel columns 31-1, ..., 31-N. A subset of the pixel circuits 100 assigned to the same row of the photoelectric conversion elements PD may form pixel rows 32-1, ..., 32-M.
[0039] The row decoder 12 and the pixel driving unit 13 control the driving of each pixel circuit 100 or each pixel row 32-1, ..., 32-M provided in the pixel array unit 11. Specifically, the row decoder 12 may provide the pixel driving unit 13 with a control signal for selecting the pixel circuit 100 of the selected pixel row 32-1, ..., 32-M according to the address latch signal from the sensor controller 15. The pixel driving unit 13 may control the FETs of the selected pixel rows 32-1, ..., 32-M according to the driver timing signal provided from the sensor controller 15 and the control signal provided from the row decoder 12.
[0040] The output signals (pixel signals) of the pixel circuits 100 of the same pixel columns 31-1, ..., 31-N are continuously provided to at least one data signal line (vertical signal line) VSL. Each data signal line VSL transmits the output signals (pixel signals) of the pixel circuits 100 of one pixel column among the pixel columns 31-1, ..., 31-N to the column signal processing unit 14.
[0041] Specifically, the solid-state imaging device 90 includes pixel circuits 100 arranged in pixel columns 31-1, ..., 31-N, wherein each pixel column 31-1, ..., 31-N is assigned to a data signal line VSL, and wherein signal output terminals of the pixel circuits 100 of the same pixel column 31-1, ..., 31-N are connected to the same common data signal line VSL.
[0042] In each pixel circuit 100, the photoelectric conversion element PD photoelectrically converts incident electromagnetic radiation into electric charge. The amount of charge generated in the photoelectric conversion element PD corresponds to the intensity of the incident electromagnetic radiation. For example, the photoelectric conversion element PD may include or consist of a photodiode, which converts electromagnetic radiation incident on a detection surface into a detector current by means of a photoelectric effect. The electromagnetic radiation may include visible light, infrared radiation and / or ultraviolet radiation. The amplitude of the detector current corresponds to the intensity of the incident electromagnetic radiation, wherein, within the intensity range of interest, the detector current increases approximately linearly with increasing intensity of the detected electromagnetic radiation.
[0043] The illustrated configuration example of the pixel circuit 100 includes, in addition to the photoelectric conversion element PD, a floating diffusion region FD for storing charges supplied from the photoelectric conversion element PD, a PD reset transistor 104, a transfer transistor 101, an FD reset transistor 102, an amplification transistor 103, and a selection transistor 108. Each transistor is a FET or includes a FET.
[0044] The load path of the PD reset transistor (photodetector reset transistor) 104 is electrically connected between the positive pixel power supply potential VDDP and the cathode of the photoelectric conversion element PD. The PD reset transistor 104 serves as a reset element for precharging the cathode of the photoelectric conversion element PD. The PD reset signal PDR is provided to the gate of the PD reset transistor 104 through the PD reset control line. The PD reset signal PDR has an effective signal level and an ineffective signal level. Specifically, the activated PD reset signal PDR sets the potential at the cathode of the photoelectric conversion element PD to be equal to or approximately equal to the positive pixel power supply potential VDDP.
[0045] The load path of the transfer transistor 101 is electrically connected between the cathode of the photoelectric conversion element PD and the floating diffusion region FD. The transfer transistor 101 is used as a transfer element for transferring charge from the photoelectric conversion element PD to the floating diffusion region FD. The floating diffusion region FD is used as a temporary local charge storage. The transfer signal TG is provided to the gate (transfer gate) of the transfer transistor 101 through the transfer control line. The transfer signal TG has an effective signal level and an invalid signal level. In response to the activated transfer signal TG, the transfer transistor 101 can transfer the electrons photoelectrically converted by the photoelectric conversion element PD to the floating diffusion region FD.
[0046] The load path of the FD reset transistor (floating diffusion reset transistor) 102 is electrically connected between the positive pixel reset voltage Vres and the floating diffusion region FD. The FD reset transistor 102 is used as a reset element for resetting the floating diffusion potential Vfd of the floating diffusion region FD. The FD reset signal RFD is provided to the gate of the FD reset transistor 102 through the reset control line. The FD reset signal RFD has a valid signal level and an invalid signal level. Specifically, the activated FD reset signal RFD sets the floating diffusion potential Vfd to be equal to or approximately equal to the pixel reset voltage Vres. The pixel reset voltage Vres can be a fixed voltage, for example, a positive pixel power supply voltage VDDP, or can be adaptive and controlled by a threshold drift compensation circuit.
[0047] The floating diffusion region FD is connected to the gate of the amplifier transistor 103 serving as an amplification element. The floating diffusion region FD serves as an input node of the amplifier transistor 103.
[0048] The amplifier transistor 103 and the selection transistor 108 are connected in series between the positive pixel voltage VDDP and the data signal line VSL. Therefore, the amplifier transistor 103 is connected to the data signal line VSL through the selection transistor 108. The row selection signal SEL is provided to the gate of the selection transistor 108 through the selection control line. The row selection signal SEL has an effective signal level and an ineffective signal level.
[0049] The activated row selection signal SEL turns on the selection transistor 108 during the row selection interval. When the selection transistor 108 is turned on, the amplifier transistor 103 operates in a source follower configuration and outputs a pixel signal to the data signal line VSL at a voltage level depending on the current floating diffusion potential Vfd. The data signal line VSL transmits the pixel signal Vout from the pixel circuit 100 to the column signal processing unit 14.
[0050] During the same row selection interval, the pixel circuit 100 outputs at least two different pixel signals having different image contents recorded at different times, wherein, for an earlier pixel signal (previous pixel signal), the photoelectric conversion element PD of the pixel circuit 100 is exposed at an earlier time, for example, during an earlier row selection interval, rather than in a later pixel signal (new pixel signal).
[0051] Since the respective gates of the transfer transistor 101 , the PD reset transistor 104 , the FD reset transistor 102 , and the selection transistor 108 are connected in units of pixel rows 32 - 1 , . . . , 32 -M, these operations can be simultaneously performed for each pixel circuit 100 of one pixel row 32 - 1 , . . . , 32 -M.
[0052] Each data signal line VSL is further connected to at least one of the signal conversion units 20. Each signal conversion unit 20 includes a constant current circuit 250, wherein each constant current circuit 250 is electrically connected between the data signal line VSL and the negative pixel power supply potential VSSP. Each constant current circuit 250 may include a constant current source or a switched capacitor current source that at least temporarily provides a constant current to the data signal line VSL.
[0053] The amplifier transistor 103 of the pixel circuit 100 connected to the data signal line VSL and the constant current circuit 250 connected to the data signal line complement the source follower circuit that transmits the pixel signal Vout controlled by the floating diffusion potential Vfd to the column signal processing unit 14 .
[0054] The column signal processing unit 14 may include one or more signal conversion units 20. Each signal conversion unit 20 converts a signal derived from an analog pixel signal Vout into digital data. The column signal processing unit 14 may include as many signal conversion units 20 as the pixel array unit 11 includes data signal lines VSL. Alternatively, the number of signal conversion units 20 may be less than the number of data signal lines VSL, and each signal conversion unit 20 may be multiplexed between two or more data signal lines VSL. Specifically, one data signal line VSL may connect the signal conversion unit 20 to all pixel circuits 100 of the same pixel column 31-1, ..., 31-N.
[0055] Each signal conversion unit 20 includes a differential circuit 200. The differential circuit 200 continuously receives a previous pixel signal and a new pixel signal from each pixel circuit 100 connected to the same data signal line VSL within the same row selection interval. According to two continuously received pixel signals, the differential circuit 200 generates a differential signal Vrd. The differential signal Vrd can be an analog differential signal, wherein the voltage level of the analog differential signal Vrd is a function of the voltage difference between the previous pixel signal and the new pixel signal, or can be a binary differential signal indicating whether the voltage difference meets a predetermined requirement.
[0056] The converter circuit 400 obtains digital pixel differential data PDD from the differential signal Vrd. For example, the pixel differential data PDD may include differential data and / or event information obtained by AD conversion of the analog differential signal Vrd. The differential circuit 200 and / or the converter circuit 400 may be activated in response to an activated differential control signal and deactivated in response to an inactivated differential control signal.
[0057] In addition, each signal conversion unit 20 may include an ADC unit 500 that performs analog-to-digital conversion of a single pixel signal (Vout) and outputs digital pixel intensity data PID. The ADC unit 500 may be activated in response to an activated ADC control signal and may be deactivated in response to an inactivated ADC control signal.
[0058] The readout buffer circuit 25 receives the pixel difference data PDD and / or the pixel intensity data PID.
[0059] The sensor controller 15 controls the column signal processing unit 14. Specifically, the sensor controller 15 can synchronize the AD conversion in the ADC unit 500 and the differential operation in the differential circuit 200 with the control signal of the pixel circuit 100. In addition, the sensor controller 15 can generate a readout control signal that controls the pixel differential data PDD and / or the pixel intensity data PIC to be read out from the readout buffer circuit 25 to, for example, the signal processing unit 80.
[0060] The image sensor assembly 10 may further include a noise reduction circuit, which may include a double sampling circuit 310 , a kTC noise reduction circuit 320 , and a threshold drift compensation circuit 330 .
[0061] Figure 1 One double sampling circuit 310 for each pixel column is shown. The double sampling circuit 310 is fully integrated in the signal conversion unit 20 of the pixel columns 31-1, ..., 31-N. For at least one of the previous pixel signal and the new pixel signal, or for both, the noise signal and the data signal are continuously sampled and subtracted from each other before performing a differential operation between the previous pixel signal and the new pixel signal. The double sampling circuit can reduce noise by correlated double sampling (CDS) and / or differential double sampling (DDS).
[0062] Figure 2 One kTC noise reduction circuit 320 per pixel circuit 100 and one threshold drift compensation circuit 330 per pixel column are shown. The threshold drift compensation circuit 330 is integrated in the signal conversion unit 20 of the pixel columns 31-1, ..., 31-N. Each kTC noise reduction circuit 320 is integrated in one of the pixel circuits 100. The threshold drift compensation circuit 330 generates a feedback signal FB on a feedback signal line FSL. The feedback signal line FSL can connect the output of the threshold drift compensation circuit 330 to the input of the kTC noise reduction circuit 320.
[0063] Figure 3 and Figure 4A portion of an image sensor arrangement 10 having a pixel circuit 100 and a differential circuit 200 is shown. Each pixel circuit 100 outputs a pixel signal on a data signal line VSL in response to a row selection signal SEL activated within a row selection interval. Each pixel circuit 100 includes a floating diffusion region FD, wherein a floating diffusion potential Vfd of the floating diffusion region FD determines a voltage level of a pixel signal Vout. For each pixel circuit 100, the differential circuit 200 receives two pixel signals Vout transmitted continuously from the pixel circuit 100 on the data signal line VSL within the same row selection interval, and obtains a differential signal Vrd from the two pixel signals. The solid-state imaging device 90 controls each pixel circuit 100 to output a previous pixel signal and a new pixel signal within the same row selection interval, wherein the previous pixel signal and the new pixel signal may contain image information related to imaging scenes at different points in time.
[0064] The differential circuit 200 is a part of the pixel array unit 11 , and an input terminal of the differential circuit 200 is directly connected to a data signal line VSL connected to a pixel output terminal of the pixel circuit 100 of the same pixel column.
[0065] In the same row selection interval, the differential circuit 200 receives a previous pixel signal and a new pixel signal, and obtains a differential signal Vrd from the two pixel signals, wherein the differential signal Vrd contains information on a voltage difference between the previous pixel signal and the new pixel signal.
[0066] Taking into account the information obtained from all pixel circuits 100 of the image sensor arrangement 10 , the image sensor arrangement 10 is able to output a frame difference image without the need for elaborate digital processing in a downstream processor.
[0067] The differential signal Vrd may be an analog differential signal, wherein the voltage level of the analog differential signal Vrd is a function of the voltage difference between the two pixel signals Vout. Alternatively, the differential signal Vrd may be a binary signal indicating whether the difference between the pixel signals exceeds a certain threshold.
[0068] The pixel circuit 100 may be any pixel circuit suitable for intensity readout as long as the pixel circuit 100 includes an output portion having an amplifier transistor 103 controlled by a floating diffusion potential Vfd of a floating diffusion region FD and a selection transistor 108 for selectively connecting a selected pixel circuit 100 to a data signal line VSL.
[0069] At a certain time after the exposure time has passed, the charge sampled by the photocurrent during the exposure time is transferred to the floating diffusion area FD. The floating diffusion potential Vfd is applied to the gate of the amplifier transistor 103. The row selection signal SEL is applied to the gate of the selection transistor 108. The load paths of the amplifier transistor 103 and the selection transistor 108 are connected in series between the positive pixel power supply potential VDDP and the pixel output terminal 109. The data signal line VSL electrically connects the pixel output terminals 109 of multiple identical pixel circuits 100 of the same pixel column. The constant current circuit 250 is connected between the data signal line VSL and the negative pixel power supply potential VDDP. When the selection transistor 108 is turned on during the row selection interval, the amplifier transistor 103 and the constant current circuit 250 complement each other to form a source follower circuit.
[0070] Specifically, the solid-state imaging device controls the floating diffusion region FD to hold the floating diffusion potential Vfd from the start of reading out a new pixel signal in the first row selection interval of the pixel circuit 100 until the end of reading out a previous pixel signal in the second row selection interval of the pixel circuit 100 .
[0071] The first row selection interval and the second row selection interval are consecutive row selection intervals of the same pixel row. The time interval between the first row selection interval and the second row selection interval is approximately the inverse of the frame rate.
[0072] The floating diffusion region FD is designed so that the leakage current from the floating diffusion region is negligible during the period between two readouts of the same pixel row.
[0073] The differential circuit 200 may include an amplifier circuit 205 , a sampling capacitor 201 of a first input branch between a data signal line VSL and an inverting input of the amplifier circuit 205 , and a switchable feedback path 202 between an output of the amplifier circuit 205 and the inverting input of the amplifier circuit 205 .
[0074] The solid-state imaging device 90, for example, Figure 2 The sensor controller 15 shown can control the differential circuit 200 to sample a voltage corresponding to a signal level of a first pixel signal across the sampling capacitor 201 in a first stage, and obtain an analog differential signal Vrd from a difference between the voltage sampled at the sampling capacitor 201 and a voltage level of a second pixel signal applied to an input electrode of the sampling capacitor 200 in a second stage.
[0075] Specifically, amplifier circuit 205, sampling capacitor 201 and switchable feedback path 202 can be used to directly compare the previous pixel signal and the new pixel signal, or can be used for double sampling, for example, to subtract the pixel noise signal from the pixel data signal of the previous pixel signal and / or the new pixel signal.
[0076] The differential circuit 200 and the constant current circuit 250 may be part of a signal conversion unit 20 connected to the data signal line VSL. The signal conversion unit 20 further includes an ADC unit 500 that performs analog-to-digital conversion of a single pixel signal Vout and outputs digital pixel intensity data PID. The ADC unit 500 may be activated in response to an activated ADC control signal AEN and deactivated in response to an inactivated ADC control signal AEN. When deactivated, the ADC unit 500 typically consumes only a negligible amount of power.
[0077] The signal conversion unit 20 may further include a converter circuit 400 that obtains digital pixel differential data PDD from the differential signal Vrd. The pixel differential data PDD may include, for example, differential data obtained by AD-converting an analog differential signal, and / or event information.
[0078] exist Figure 3 , the pixel circuit 100 includes an FD reset transistor 102 for resetting the potential of the floating diffusion region FD in response to an activated FD reset signal. The image sensor assembly 10 further includes a kTC noise reduction circuit 320 and a threshold drift compensation circuit 330. The kTC noise reduction circuit 320 reduces the kTC noise generated in the floating diffusion region FD by turning off the FD reset transistor 102. To this end, when the FD reset transistor 102 is turned off, the kTC noise reduction circuit 320 provides a parallel capacitance path for charge carriers, and then turns off the parallel capacitance path so that the kTC noise is partially generated in a node that has a smaller impact on the pixel signal, and only a portion of the kTC noise is generated in the floating diffusion region FD and / or transmitted to the floating diffusion region FD.
[0079] The threshold shift compensation circuit 330 compensates for the threshold voltage fluctuation of the amplifying transistor 103 by adjusting the reset voltage of the floating diffusion region FD for each pixel circuit 100 respectively, the adjustment being performed according to the voltage level on the data signal line VSL when the floating diffusion FD is reset.
[0080] exist Figure 4 In the embodiment, the image sensor assembly 10 includes a double sampling circuit 310, which reduces noise by applying a double sampling method such as correlated double sampling (CDS) and / or differential double sampling (DDS). The double sampling method relies on reading out the same pixel circuit 100 twice, once after the floating diffusion region FD receives the charge generated during the exposure process and before the FD is reset, and the other time after the FD is reset and before the floating diffusion region FD receives the charge generated during the exposure process, or vice versa.
[0081] Specifically, each readout of the pixel circuit 100 includes two time periods: in the first time period (data phase, D phase), after the floating diffusion area FD receives the charge generated during exposure and is sampled, the first pixel signal (data signal) is read out. In the second time period (preset phase, P phase), the second pixel signal (noise signal) of the non-illuminated pixel is read out, for example, after the FD is reset and before the floating diffusion area FD receives the charge generated during exposure. The second time period may be directly before the first time period, or may be directly after the first time period. The final pixel output value is obtained by subtracting the second pixel signal (noise signal) from the sampled first pixel signal (data signal), wherein the effect of noise on the final pixel output value can be reduced. According to the CDS readout method, the P phase precedes the D phase. In the DDS readout method, the D phase precedes the P phase.
[0082] The operations of the dual sampling circuit 310 and the differential circuit 200 may be intertwined, and the dual sampling circuit 310, the differential circuit 200 and / or the pixel circuit 100 may share some resources, such as one or more circuit elements, wherein the shared circuit elements perform different tasks for different circuits.
[0083] The double sampling circuit 310 may be fully formed as part of the signal conversion unit 20. Noise reduction without providing feedback to the pixel circuit 100 may allow for faster operation, for example, faster frame readout.
[0084] exist Figure 5 In further embodiments, the pixel circuit 100 is based on the floating diffusion region FD, and a floating diffusion potential Vfd of the floating diffusion region FD determines a voltage level of the pixel signal Vout.
[0085] The pixel circuit 100 may further include a photoelectric conversion element PD that determines a floating diffusion potential Vfd by a photocurrent and a transfer transistor 101 that connects a cathode of the photoelectric conversion element PD and a floating diffusion region FD in response to an activated transfer signal TG in a row selection interval. The transfer transistor 101 may allow output of two pixel signals from two consecutive exposures, provided that a leakage current from the floating diffusion region is sufficiently low.
[0086] The pixel circuit 100 may further include a photodetector reset transistor 104 that resets the potential at the cathode of the photoelectric conversion element PD to a fixed potential in response to an activated photodetector reset signal PDR. The photodetector reset transistor 104 provides more leeway for determining the length of the exposure time.
[0087] In addition, the pixel circuit 100 may include a floating diffusion reset transistor 102 that connects the floating diffusion region FD to a pixel reset voltage Vres in response to at least an activated photodetector reset signal FDR. The resetting of the floating diffusion region FD may be controlled by the floating diffusion reset signal FDR alone or in combination with one or more other control signals. The pixel reset voltage Vres may be a fixed voltage (e.g., a positive pixel power supply potential VDDP) or an adaptive voltage.
[0088] exist Figure 5 , the differential circuit 200 includes an amplifier circuit 205 , a sampling capacitor 201 electrically connected between a data signal line VSL and an inverting input terminal of the amplifier circuit 205 , and a switchable feedback circuit 202 between an output terminal of the amplifier circuit 205 and an inverting input terminal of the amplifier circuit 205 .
[0089] The feedback circuit 202 includes a gain capacitor 203 electrically connected between the output terminal (amplifier output terminal) of the amplifier circuit 205 and the inverting input terminal (inverting amplifier input terminal) of the amplifier circuit 205. The auto-zero switch element 204 is electrically connected between the amplifier output terminal and the inverting amplifier input terminal. The activated auto-zero signal AZ turns on the auto-zero switch element 204 and sets the potential at the inverting amplifier input terminal to the potential applied to the non-inverting amplifier input terminal. The potential applied to the non-inverting amplifier input terminal may be fixed or variable.
[0090] Solid-state imaging device 90, in particular Figure 2 The sensor controller 15 in the embodiment controls the differential circuit 200 to sample a voltage corresponding to the signal level of a previous pixel signal across the sampling capacitor 201 in the first stage, and obtains an analog differential signal Vrd in the second stage from the difference between the voltage sampled at the sampling capacitor 201 and the voltage level of the next pixel signal applied to the input electrode of the sampling capacitor 200. The previous pixel signal and the new pixel signal contain image information related to the imaged scene at different time points.
[0091] Differential circuit 200 uses sampling capacitor 201, amplifier circuit 205, gain capacitor 203, and auto-zero switch element 204 to compare a new pixel signal to a previous pixel signal.
[0092] The amplifier circuit 205 receives a constant reference voltage Vref at a non-inverting input terminal.
[0093] The differential circuit 200 is capable of continuously receiving the previous pixel signal and the new pixel signal from the same pixel circuit 100 within the same row selection interval, storing a voltage across the sampling capacitor 201 corresponding to the voltage level of the previous pixel signal by setting the potential at the inverting amplifier input terminal to be equal to the potential at the non-inverting amplifier input terminal in the first stage, and subtracting the voltage across the sampling capacitor 201 from the voltage level of the new pixel signal level by floating the inverting amplifier input terminal in the second stage. Therefore, the amplifier circuit 205 outputs an analog differential signal Vrd, wherein the voltage level of the analog differential signal Vrd is a function of the difference between the signal levels of the previous pixel signal and the new pixel signal, in particular, an almost linear function.
[0094] In essence, the differential circuit 200 uses the floating diffusion region FD in the pixel circuit 100 as a storage element, which stores new floating diffusion potentials corresponding to new pixel signals for each pixel circuit 100, which potentials correspond to the new pixel signals until the pixel circuit 100 is addressed in the next frame, wherein in the next frame, the original "new" floating diffusion potential Vfd becomes the next "previous" floating diffusion potential Vfd, thereby determining the next previous pixel output signal.
[0095] Figure 5 The differential circuit 200 can be combined with various noise reduction circuits.
[0096] The solid-state imaging device may include a kTC noise reduction circuit configured to reduce kTC noise in a pixel signal before obtaining a differential signal Vrd.
[0097] Specifically, each pixel circuit 100 may include a kTC noise reduction circuit 320 capable of reducing reset noise generated by charges stored in the floating diffusion region FD each time the floating diffusion region FD is separated from the positive pixel power supply potential VDDP.
[0098] Fig. 6A Will Figure 5 The differential circuit 200 is combined with a kTC noise reduction circuit 320 and a threshold shift compensation circuit 330. The pixel circuit 100 is a 5T pixel including a PD reset transistor 104 controlled by a PD reset signal PDR.
[0099] The solid-state imaging device includes a threshold shift compensation circuit 330 that controls a pixel reset voltage Vres according to a current voltage of a pixel signal Vout on a data signal line VSL.
[0100] Specifically, the threshold shift compensation circuit 330 may include a column feedback amplifier 305. The pixel signal Vout on the data signal line VSL is applied to the inverting input terminal of the column feedback amplifier 305. The standard voltage Vst is applied to the non-inverting input terminal of the column feedback amplifier 305. The standard voltage Vst is used as a reference for the pixel signal generated by the pixel circuit 100. For example, the standard voltage Vst may correspond to an expected signal level of the pixel signal of the non-illuminated pixel.
[0101] The column feedback amplifier 305 generates a feedback signal FB on the feedback signal line FSL. The voltage level of the feedback signal FB is a function of the difference between the pixel signal Vout and the standard voltage Vst. The feedback signal line FSL connects the output of the column feedback amplifier 305 to the kTC noise reduction circuit 320. The solid-state imaging device further includes a kTC noise reduction circuit 320 integrated in the pixel circuit 100.
[0102] To this end, the pixel circuit 100 further includes an auxiliary transistor 321 and a pixel coupling capacitor 323. The auxiliary transistor 321 is electrically connected in series between the FD reset transistor 102 and the node providing the pixel reset voltage Vres. The auxiliary transistor 321 connects the FD reset transistor 102 to the node providing the pixel reset voltage Vres in response to the activated auxiliary signal AXR. The pixel coupling capacitor 323 is electrically connected in parallel to the FD reset transistor 102.
[0103] In the illustrated embodiment, the auxiliary transistor 321 is electrically connected between the feedback signal line FSL and a side of the FD reset transistor 102 that avoids the floating diffusion region FD. The activated auxiliary signal AXR turns on the auxiliary transistor 321.
[0104] Each kTC noise reduction circuit 320 may further include a pixel storage capacitor 322 and a pixel coupling capacitor 323, the pixel storage capacitor being electrically connected between a constant voltage (e.g., a positive pixel power supply potential VDDP) and a node between the FD reset transistor 102 and the auxiliary transistor switch 321, and the pixel coupling capacitor being electrically connected between the floating diffusion region FD and a node between the FD reset transistor 102 and the auxiliary transistor 321. The capacitance of the pixel storage capacitor 322 may be of the same order of magnitude as the capacitance of the floating diffusion region FD, for example, approximately the same. The capacitance of the pixel coupling capacitor 323 may be less than the capacitance of the floating diffusion region FD.
[0105] When the reset transistor 102 is turned off in the pixel circuit 100 without the pixel coupling capacitor 323, reset kTC noise is generated in the floating diffusion region FD. The noise charge is a function of kTC, where k is the Boltzmann constant, T is the temperature and C is the capacitance of the floating diffusion region FD. Reducing the C of the floating diffusion region FD will reduce the dynamic range of the pixel circuit 100. Conversely, when Fig. 6A When the FD reset transistor 102 in the pixel circuit 100 is turned off, the pixel coupling capacitor 323 and the auxiliary transistor 321 form an alternative path for charge carriers, provided that the auxiliary transistor 321 is still turned on. When the auxiliary transistor 321 is turned off later, a relatively low reset noise is generated in the floating diffusion region FD.
[0106] Figure 2 The sensor controller 15 can be based on Figure 6B The selection signal SEL, the PD reset signal PDR, the FD reset signal FDR, the transmission signal TG and the auxiliary signal AXR are controlled according to the timing diagram shown.
[0107] Between t=t1 and t=t2, the reset pulse in the PD reset signal PDR resets the potential on the cathode of the photoelectric conversion element PD to the positive pixel power supply potential VDDP. At t=t2, the end of the reset pulse marks the beginning of the exposure time.
[0108] At t=t3, the activated row select signal SEL turns on the select transistor 108 and applies the previous pixel signal to the data signal line VSL according to the previous floating diffusion potential Vfd. At the end of the short pulse in the auto-zero signal, i.e., between t=t4 and t=t5, the voltage level of the previous pixel signal is sampled across the sampling capacitor 201. Starting from t=t5, the non-inverting input of the amplifier circuit 205 floats, and the differential signal Vrd at the output of the amplifier circuit 205 is a function of the voltage difference between the current signal on the data signal line VSL and the previous pixel signal.
[0109] At t=t6, both the FD reset signal FDR and the auxiliary signal AXR become active. The FD reset transistor 102 and the auxiliary transistor 321 are turned on and connect the floating diffusion region FD and the feedback signal line FSL, wherein the floating diffusion region FD is set to a reset potential that compensates for the temperature drift of the threshold voltage of the amplifier transistor 103 and / or the pixel-to-pixel variation to some extent.
[0110] At t=t7, first, the FD reset signal FDR becomes inactive and turns off the FD reset transistor 102. No reset noise or only low reset noise is generated in the floating diffusion region FD due to the parallel path through the coupling capacitor 323. Then, at t=t8, the auxiliary signal AXR becomes inactive and turns off the auxiliary transistor 321, wherein the floating diffusion region is finally switched free without generating significant reset noise in the floating diffusion region FD.
[0111] Between t=t8 and t=t9, the transfer transistor 101 is turned on and connects the floating diffusion region FD and the cathode of the photoelectric conversion element PD. The exposure time of the new pixel signal ends at t=t8. After t=t9, the pixel circuit 100 outputs a new pixel signal showing only low kTC noise.
[0112] When the pixel circuit 100 is deselected, a new pixel signal is available on the data signal line VSL until t=t10. Between t=t9 and t=t10, the voltage level of the analog differential signal Vrd is a function, in particular a nearly linear function, of the difference between the signal levels of the previous pixel signal and the new pixel signal. Figure 2 The converter circuit 400 shown may latch the differential signal Vrd between t=t9 and t=t10.
[0113] The floating diffusion region FD stores the floating diffusion potential Vfd of the new pixel signal until the next pixel circuit reads it out, at which time the original new pixel signal becomes the new previous pixel signal.
[0114] Fig. 7A The pixel circuit 100 and Figure 5 The pixel circuit in FIG. 1 is different in that the PD reset transistor 104 is missing. Figure 7B As shown, the exposure time is determined by the time distance between two consecutive pulses in the transmission signal TG. The pixel circuit 100 can be used in combination with any differential circuit 200 of the present disclosure as long as the exposure time can be constant and equal to the inverse of the frame rate.
[0115] As described above, the solid-state imaging device 90, for example, Figure 2 The sensor controller 15 shown can control the differential circuit 200 to sample the voltage corresponding to the signal level of the first pixel signal at both ends of the sampling capacitor 201 in the first stage, and obtain the analog differential signal Vrd from the difference between the voltage sampled at the sampling capacitor 201 and the voltage level of the second pixel signal applied to the input electrode of the sampling capacitor 200 in the second stage.
[0116] While in the previous embodiments, the differential circuit 200 compares the new pixel signal as the second pixel signal with the previous pixel signal as the first pixel signal, the latter embodiments use the same elements for double sampling to obtain noise-reduced versions of the previous pixel signal and / or the new pixel signal.
[0117] Specifically, the first pixel signal is a pixel noise signal of the pixel signal and the second pixel signal is a pixel data signal of the pixel signal, or the first pixel signal is a pixel data signal of the pixel signal and the second pixel signal is a pixel noise signal of the pixel signal, wherein the pixel noise signal originates from unexposed pixels and the pixel data signal originates from exposed pixels.
[0118] In other words, the pixel noise signal corresponds to the pixel output signal of the unexposed (dark) pixel, and the pixel data signal corresponds to the pixel output signal of any exposed (bright) pixel, wherein the pixel data signal contains noise.
[0119] The pixel signal may be a new pixel signal or a previous signal. Alternatively, the method is used for both the new pixel signal and the previous signal separately, as is the case with the next embodiment.
[0120] Fig. 8A The present invention relates to an embodiment having a differential circuit 200, which includes a fully differential amplifier 217 and a sample / hold circuit 218, which is electrically connected between a data signal line VSL in a first input branch and a first input terminal of the fully differential amplifier 217. A second input branch couples the data signal line VSL and a second input terminal of the fully differential amplifier 217.
[0121] The fully differential amplifier 217 is a high gain electronic voltage amplifier having a differential input terminal and a differential output terminal. The first input terminal (first amplifier input terminal) of the fully differential amplifier 217 can be an inverting input terminal among the differential input terminals. The second input terminal (second amplifier input terminal) of the fully differential amplifier 217 can be a non-inverting input terminal among the differential input terminals. The first output terminal (first amplifier output terminal) of the fully differential amplifier 217 can be an inverting output terminal among the differential output terminals. The second output terminal (second amplifier output terminal) of the fully differential amplifier 217 can be a non-inverting output terminal among the differential output terminals. The differential output signal directly provides an analog differential signal Vrd.
[0122] The sample / hold signal S / H controls the sample / hold circuit 218. The activated sample / hold signal S / H controls the sample / hold circuit to transfer the signal present on the data signal line VSL to the output terminal of the sample / hold circuit 218. When the sample / hold signal becomes inactive, the output terminal of the sample / hold circuit 218 is separated from the input terminal and the data signal line VSL.
[0123] In the first pixel signal phase, the data signal line VSL transmits the previous pixel signal to the sample / hold circuit 218, and the sample / hold circuit 218 transmits the previous pixel signal to the first amplifier input terminal. For the second pixel signal phase, the sample / hold circuit 218 interrupts the path between the data signal line VSL and the first amplifier input terminal, so that in the second pixel phase, the new pixel signal is only transmitted to the second amplifier input terminal.
[0124] The fully differential amplifier 217 is embedded in a local feedback circuit so that the fully differential amplifier 217 outputs an analog differential signal Vrd, whose voltage level is a function of the difference between the signal levels at the first amplifier input and the second amplifier input.
[0125] The double sampling circuit 310 modifies the previous pixel signal and the new pixel signal before processing the analog differential signal Vrd.
[0126] To this end, the solid-state imaging device includes a first sampling capacitor 211 in a portion of the first input branch located between the sample / hold circuit 218 and the first input terminal of the differential amplifier circuit 217, a second sampling capacitor 311 between the data line VSL in the second input branch and the second input terminal of the differential amplifier circuit 217, a first gain capacitor 213 between the second amplifier output terminal and the first amplifier input terminal in the first feedback path, and a second gain capacitor 313 between the first amplifier output terminal and the second amplifier input terminal in the second feedback path.
[0127] The first gain capacitor 213 and the second gain capacitor 313 may be resettable, wherein electrodes of the first gain capacitor 213 are temporarily short-circuited, and wherein electrodes of the second gain capacitor 313 are also temporarily short-circuited.
[0128] The first sampling capacitor 211 and the first gain capacitor 213 facilitate double sampling of the previous pixel signal by sequentially applying the pixel data signal of the previous pixel signal and the pixel noise signal of the new pixel signal to the input electrode of the first sampling capacitor 211 and subtracting the pixel noise signal from the pixel data signal by intermediate resetting of the potential at the first amplifier input terminal.
[0129] The second sampling capacitor 311 and the second gain capacitor 313 facilitate double sampling of the new pixel signal by sequentially applying the pixel noise signal and the pixel data signal of the new pixel signal to the input electrode of the second sampling capacitor 311 and subtracting the pixel noise signal from the pixel data signal by an intermediate reset of the potential at the second amplifier input terminal. The pixel noise signal of the new pixel signal is used for both DDS with the pixel data signal of the previous pixel signal and CDS with the pixel data signal of the new pixel signal.
[0130] The fully differential amplifier 217 is part of both the differential circuit 200 and the double sampling circuit 310 .
[0131] In order to reset the first gain capacitor 213 and the second gain capacitor 313 and initialize the differential circuit 200, the double sampling circuit 310 includes a first auto-zero switch 212 between the second amplifier output terminal and the first amplifier input terminal, and a second auto-zero switch 312 between the first amplifier output terminal and the second amplifier input terminal. The activated first auto-zero signal AZ1 turns on the first auto-zero switch 212 and resets the potential at the first amplifier input terminal and the potential at the second amplifier output terminal. The activated second auto-zero signal AZ2 turns on the second auto-zero switch 312 and resets the potential at the second amplifier input terminal with the reference potential Vref.
[0132] The first initialization switch 315 is connected between the second amplifier output terminal and the reference potential Vref, and the second initialization switch 316 is connected between the first amplifier output terminal and the reference potential Vref. The first side of the third initialization switch 317 is connected to the second auto-zero switch 312 and the second initialization switch 316. The second side of the third initialization switch 317 is connected to the second gain capacitor 313 and the first amplifier output terminal. The activated initialization signal INIT turns on the first initialization switch 315 and turns off the third initialization switch 317, wherein the potential at the first amplifier input terminal is reset to the reference potential Vref when the first auto-zero switch 212 is turned on. In addition, the activated initialization signal INIT turns on the second initialization switch 316, and when the second auto-zero switch 312 is turned on, the potential at the second amplifier input terminal is reset with the reference potential Vref.
[0133] Figure 1 The sensor controller 15 can be based on Figure 8B The timing diagram shown controls the selection signal SEL, the FD reset signal, the transmission signal TG, the initialization signal INIT, the first auto-zero signal AZ1, the second auto-zero signal AZ2, and the sample / hold signal S / H.
[0134] At t= t1 , the activated row selection signal SEL turns on the selection transistor 108 and applies the pixel data signal of the previous pixel signal to the data signal line VSL.
[0135] At t=t2, the initialization signal INIT, the first auto-zero signal AZ1, the second auto-zero signal AZ2, and the sample / hold signal S / H become active. The potentials at the first amplifier input terminal and the second amplifier input terminal are reset to the reference potential Vref. The sample / hold circuit 215 becomes transparent and the pixel data signal of the previous pixel signal is applied to the first sampling capacitor 211. A voltage corresponding to the difference between the voltage level of the pixel data signal of the previous pixel signal and the reference voltage drops across the first sampling capacitor 211.
[0136] At t=t3, the initialization signal INIT becomes inactive, and the first initialization switch 315 and the second initialization switch 316 are turned off. At t=t4, the first auto-zero signal AZ1 becomes inactive, the first auto-zero switch 212 is turned off, and the potential at the first amplifier input terminal starts to float.
[0137] In the pixel circuit 100, the activated FD reset pulse between t=t5 and t=t6 sets the floating diffusion potential Vfd to the reset voltage. The pixel circuit 100 outputs a pixel noise signal for a new pixel signal. The potential generated at the floating first amplifier input terminal is a function of the difference between the signal levels of the pixel data signal of the previous pixel signal and the pixel noise signal. In this way, the portion of the double sampling circuit connected to the first amplifier input terminal performs differential double sampling on the previous pixel signal by using the pixel data signal of the previous pixel signal and the pixel noise signal of the new pixel signal.
[0138] Following the falling edge of the sample / hold signal S / H at t=t7, the sample / hold circuit 215 decouples the first amplifier input terminal from the data signal line VSL. The potential generated by the DDS of the previous pixel signal is held at the first amplifier input terminal.
[0139] At the same time, the same pixel noise signal is applied to the second sampling capacitor 311. When the second auto-zero signal AZ2 becomes inactive at t=t8, the second auto-zero switch 312 is turned off, the potential at the second amplifier input terminal starts to float, and a voltage drop corresponding to the voltage level of the pixel noise signal is sampled across the second sampling capacitor 311. This pixel noise signal is considered to be a noise component of the new pixel.
[0140] The activated transfer signal TG between t=t9 and t=10 connects the cathode of the photoelectric conversion element PD and the floating diffusion FD. The pixel circuit 100 outputs the pixel data signal of the new pixel signal. The potential generated on the floating second amplifier input terminal in the differential circuit 200 is a function of the difference between the signal levels of the pixel data signal of the new pixel signal and the pixel noise signal. In this way, the portion of the noise reduction circuit connected to the second amplifier input terminal performs correlated double sampling on the new pixel signal by using the pixel data signal of the new pixel signal and the pixel noise signal of the new pixel signal.
[0141] At t=t11, the select signal becomes inactive. Between t=t10 and t=t11, the fully differential amplifier outputs an analog differential signal having a voltage level that is a function of the difference in voltage levels of the previous pixel signal corrected by DDS and the new pixel signal corrected by CDS, for example, a nearly linear function.
[0142] exist Fig. 9A In the example, the signal conversion unit 20 uses a signal having a Figure 5 The differential circuit 200 of the sampling capacitor 201, the amplifier circuit 205, the gain capacitor 203 and the auto-zero switch element 204 is described to reduce noise by double sampling.
[0143] The sampling capacitor 201 receives the pixel signal at the first capacitor electrode (capacitor input electrode). The second capacitor electrode of the sampling capacitor 201 is electrically connected to the inverting input of the amplifier circuit 205. The gain capacitor 203 is electrically connected between the output of the amplifier circuit 205 (amplifier output) and the inverting input of the amplifier circuit 205 (inverting amplifier input). The auto-zero switch element 204 is electrically connected between the amplifier output and the inverting amplifier input. The activated auto-zero signal AZ turns on the auto-zero switch element 204 and sets the potential at the inverting amplifier input to the potential applied to the non-inverting amplifier input. The potential applied to the non-inverting amplifier input is switchable.
[0144] The complementary sampling capacitor 221 is in a path connecting the data signal line VSL and the non-inverting input terminal (non-inverting amplifier input terminal) of the amplifier circuit 205. The first sampling switch element 222 is electrically connected between the data signal line VSL and the first electrode of the complementary sampling capacitor 221. The activated first auto-zero signal AZ1 turns on the first sampling switch element 222 and connects the complementary sampling capacitor 221 to the data signal line VSL.
[0145] A constant reference voltage Vref is applied to the non-inverting amplifier input. A second sampling switch element 223 is electrically connected between the second electrode of the complementary sampling capacitor 221 and the non-inverting amplifier input. The activated first auto-zero signal AZ1 turns on the second sampling switch element 223 and connects the complementary sampling capacitor element 221 to the non-inverting amplifier input and the reference voltage Vref.
[0146] The second auto-zero switch element 224 is electrically connected between the amplifier output and the second electrode of the complementary sampling capacitor 221. The activated second auto-zero signal AZ2 turns on the second auto-zero switch element 224 and sets the potential at the second electrode of the complementary sampling capacitor 221 to the potential at the amplifier output.
[0147] The input terminal of the output buffer 225 is electrically connected to the first electrode of the complementary sampling capacitor 221 and outputs an analog differential signal Vrd, which is a function of the voltage difference between the previous pixel signal and the new pixel signal, specifically, an approximately linear function.
[0148] Figure 1 The sensor controller 15 can be based on Fig. 9B The selection signal SEL, the FD reset signal FDR, the transmission signal TG, the auto-zero signal AZ, the first auto-zero signal AZ1 and the second auto-zero signal AZ2 are controlled according to the timing diagram shown.
[0149] At t= t1 , the activated row selection signal SEL turns on the selection transistor 108 and applies the pixel data signal of the previous pixel signal to the data signal line VSL.
[0150] At t=t2, the auto-zero signal AZ and the first auto-zero signal AZ1 become active. The potential at the inverting amplifier input terminal is reset to the reference potential Vref. The first sampling switch element 222 and the second sampling switch element 223 connect the complementary sampling capacitor 221 to the data signal line VSL and the non-inverting amplifier input terminal.
[0151] At t=t3, the first sampling switch element 222 and the second sampling switch element 223 disconnect the complementary sampling capacitor 221 from the data signal line VSL and the non-inverting amplifier input terminal, wherein the previous pixel signal is sampled in the voltage across the complementary sampling capacitor 221.
[0152] The activated FD reset pulse between t=t4 and t=t5 sets the floating diffusion potential Vfd to the reset voltage obtained from the output of the column feedback amplifier 305 to compensate for temperature-related fluctuations in the threshold voltage of the amplification transistor 103. After t=t5, the pixel circuit 100 outputs a pixel noise signal of a new pixel signal.
[0153] When the auto-zero signal AZ becomes inactive and the auto-zero switch 204 is turned off at t=t6, the potential at the second amplifier input terminal starts floating and a voltage drop corresponding to the voltage level of the pixel noise signal is sampled across the sampling capacitor 201.
[0154] The activated transfer signal TG between t=t7 and t=t8 connects the cathode of the photoelectric conversion element PD and the floating diffusion region FD. The pixel circuit 100 outputs the pixel data signal of the new pixel signal. The potential generated at the floating second amplifier input terminal is a function of the difference between the signal levels of the pixel data signal of the new pixel signal and the pixel noise signal. In this way, the amplifier circuit 205, the sampling capacitor 201, the gain capacitor 203 and the auto-zero switch element 203 are combined to perform correlated double sampling on the new pixel signal, and the amplifier circuit 205 outputs the CDS-corrected new pixel signal.
[0155] Between t=t9 and t=t10, the amplifier output is connected to the second electrode of the complementary sampling capacitor 221. At t=t3, the voltage at the first electrode of the sampling capacitor 211 corresponds to the difference between the amplifier output signal and the voltage sampled across the sampling capacitor element 211. The buffer circuit 215 outputs a buffered output signal having a voltage level that is a function of the difference in voltage levels of the previous pixel signal and the CDS-corrected new pixel signal, e.g., a nearly linear function.
[0156] Fig.10 It shows that Fig. 9A The differential circuit 200 with integrated CDS correction for the new pixel signal is shown in FIG. Fig. 6A The kTC noise reduction circuit 320 is a combination of the above-mentioned kTC noise reduction circuit 320.
[0157] Figure 1 The sensor controller 15 can be based on Fig.11 The selection signal SEL, the FD reset signal FDR, the auxiliary signal AXR, the transmission signal TG, the auto-zero signal AZ, the first auto-zero signal AZ1 and the second auto-zero signal AZ2 are controlled according to the timing diagram shown.
[0158] Fig.11 The timing diagram in Fig. 9BThe difference in the timing diagram in is that at t=t4, the auxiliary transistor 321 is turned on simultaneously with the FD reset transistor 102, so that the floating diffusion potential Vfd is set to the reset voltage obtained from the feedback signal FB to compensate for the pixel-to-pixel variation and / or temperature-related fluctuation of the threshold voltage of the amplifier transistor 103. When t=t5, the FD reset transistor is turned off, and no or only low reset noise is generated in the floating diffusion area FD due to the parallel path through the auxiliary transistor 321 and the pixel coupling capacitor 323. When at t=t51, the auxiliary transistor 321 is turned off, and only low reset noise is generated in the floating diffusion area FD.
[0159] The analog differential signal Vrd can be AD converted by a typical ADC, as used for intensity readout. For example, the same ADC can be switchable and can AD convert a single pixel signal Vout in intensity readout mode and can AD convert the analog differential signal Vrd in frame differential mode.
[0160] According to the following embodiment, a solid-state imaging device includes a converter circuit 400 that gates a differential signal Vrd using at least one threshold signal.
[0161] Each threshold signal may be a constant voltage, wherein the constant voltage may be fixed, configurable or adaptive. Alternatively, the threshold signal may vary over time. The converter circuit 400 enables pre-processing of the analog differential signal Vrd output from the differential circuit 200, thereby reducing the computational burden on the downstream image processor.
[0162] According to an embodiment, the converter circuit 400 can obtain the event information signal EV from the differential signal Vrd. To this end, the converter circuit 400 can gate the analog differential signal Vrd with two constant threshold voltages to obtain the digital event information signal. The two constant threshold voltages can be fixed voltage levels or can be adapted during operation.
[0163] Fig.12 A converter circuit 400 is shown, which includes a sample / hold portion 410 for latching an analog differential signal Vrd. A first comparator portion 421 compares the latched analog differential signal Vrd with a first threshold voltage. The binary output signal of the first comparator portion 421 has a valid voltage level ("1") only when the latched analog differential signal Vrd is higher than the first threshold voltage. A second comparator portion 422 compares the latched analog differential signal Vrd with a second threshold voltage. The binary output signal of the second comparator portion 422 has a valid voltage level ("1") only when the latched analog differential signal Vrd is lower than the second threshold voltage.
[0164] exist Fig.13 , the converter circuit 400 includes a sample / hold portion 410, a low-resolution analog-to-digital converter 430 that converts the analog differential signal Vrd into a digital differential signal, and an event encoder 440. The analog-to-digital converter 430 may include a 2-bit quantizer circuit with an adjustable threshold level, and detects a frame differential of the addressed pixel circuit 100 above the adjustable threshold in a positive direction or a negative direction.
[0165] The event encoder 440 maps the result of the AD conversion to a digital event code. For example, a negative event may be encoded as "00", a positive event may be encoded as "11", and no event may be encoded as "01" and / or "10". The event encoder 440 may output the encoded event in the data stream, or may add the pixel address of the pixel circuit for which the event has been detected, so that the event encoder 440 only outputs the pixel address and outputs a data bit indicating the event type for each pixel address.
[0166] Fig.14 Another embodiment relates to a converter circuit 400 comprising an analog-to-digital converter 430. The solid-state imaging device 90 is configured to control the analog-to-digital converter 430 so that the difference signal Vrd is quantized with high accuracy only when the difference signal Vrd is above a predefined frame difference threshold after k quantization steps out of N possible quantization steps.
[0167] Otherwise, quantization is stopped. In this way, irrelevant or low-relevant quantization can be omitted and the power consumption of the converter circuit can be reduced. The N possible quantization step sizes are generated by the resolution of the analog-to-digital converter.
[0168] The output data may include a pixel address combined with a quantized frame difference, or a pixel address combined with binary information ("0" or "1") indicating whether the quantized frame difference exceeds a frame difference threshold.
[0169] Fig.15A The embodiment involves the amplifier circuit 205 outputting a binary differential signal Vrd.
[0170] The differential circuit 200 includes an amplifier circuit 205, a sampling capacitor 201 between the data signal line VSL in the first input branch and the inverting input terminal of the amplifier circuits 205 and 217, and an auto-zero switch element 204 between the output terminal of the amplifier circuit 205 and the inverting input terminal of the amplifier circuit 205. In addition, the differential circuit 200 receives the variable threshold signal Vthr at the non-inverting input terminal of the amplifier circuit 205. The reference numeral 204 may be omitted. Figure 5 Gain capacitor 203 is described.
[0171] The variable threshold signal Vthr may be a digital signal whose voltage level varies between at least two different voltage levels, such as a ternary signal whose voltage level varies between three different voltage levels. When the auto-zero switch element 204 is turned off in the switchable feedback path 202 between the amplifier output and the inverting amplifier input, the amplifier output and the inverting amplifier input are completely separated, and the feedback loop is disconnected. The amplifier circuit 205 outputs a binary differential signal Vrd indicating whether the voltage difference between the previous pixel signal and the new pixel signal exceeds or is below a predetermined threshold value, which depends on the current voltage level of the variable threshold signal Vthr.
[0172] The converter circuit 400 includes a first single-bit memory 451 and a second single-bit memory 452 which continuously latch a comparison result of a voltage difference between a previous pixel signal and a new pixel signal.
[0173] like Fig. 15B As shown, the first single-bit memory 451 latches the comparison result with the positive or higher threshold voltage Vthr_Off applied to the non-inverting input terminal of the amplifier circuit 205 when the rising edge of the LAT_OFF signal is t=t12 or the falling edge of the LAT_OFF signal is t=t13. The second single-bit memory 452 latches the comparison result with the negative or lower threshold voltage Vthr_On applied to the non-inverting input terminal of the amplifier circuit 205 when the rising edge of the LAT_ON signal is t=t14 or the falling edge of the LAT_ON signal is t=t15.
[0174] exist Fig.16A In the embodiment of the present invention, the components of the converter circuit 400 and the amplifier circuit 205 complement each other to form an analog-to-digital converter that directly converts the voltage difference between the previous pixel signal and the next pixel signal into a multi-bit digital value.
[0175] Specifically, the solid-state imaging device may include a ramp generator 461 that applies a voltage ramp to a non-inverting input terminal of the amplifier circuit 205 .
[0176] The amplifier circuit 205, the sampling capacitor 201, and the auto-zero switch element 204 are controlled to subtract the new pixel signal from the previous pixel signal by using the sampled voltage across the sampling capacitor 201. The ramp generator 461 generates a voltage ramp and applies the voltage ramp to the non-inverting input terminal of the amplifier circuit 205. The amplifier circuit 205 operates as a comparator, and when the voltage difference between the voltage ramps and the voltage difference between the previous pixel signal and the next pixel signal change signs, the amplifier circuit changes the voltage level of the binary differential signal Vrd. The pulse generator 462 generates regular clock pulses and transmits the clock pulses to the counter circuit 465. The counter circuit 465 starts counting in synchronization with the start of the voltage ramp, and stops counting when the voltage level of the binary differential signal Vrd switches.
[0177] Fig. 16B It is shown that the counting and voltage ramping synchronously start at t=t21 and the voltage ramping ends at t=t29. The critical points of the binary differential signal Vrd are between t=t21 and t=t29 and depend on the voltage difference between the previous pixel signal and the new pixel signal.
[0178] Fig.17 23020 is a perspective view showing an example of a laminated structure of a solid-state imaging device having a plurality of pixel circuits arranged in a matrix in an array form. Each pixel circuit includes at least one photoelectric conversion element.
[0179] The solid-state imaging device 23020 has a laminated structure of a first chip (upper chip) 910 and a second chip (lower chip) 920. The laminated first chip 910 and the second chip 920 may be electrically connected to each other through through-contact (silicon) vias (TC(S)V) formed in the first chip 910. The solid-state imaging device 23020 may be formed to have a laminated structure such that the first chip 910 and the second chip 920 are bonded together at the wafer level and cut out by dicing.
[0180] In the laminated structure of upper and lower two chips, the first chip 910 may be an analog chip (sensor chip) including at least one analog component per pixel circuit, for example, photoelectric conversion elements arranged in an array form.
[0181] For example, the first chip 910 may include only the photoelectric conversion element of the pixel circuit, as described above with reference to the aforementioned figure. Alternatively, the first chip 910 may include additional elements of each pixel circuit. For example, in addition to the photoelectric conversion element, the first chip 910 may include at least a transfer transistor, a reset transistor, an amplification transistor and / or a selection transistor of the pixel circuit. Alternatively, the first chip 910 may include each element of the pixel circuit. In addition to the elements of the pixel circuit, the first chip 910 may include one element, some elements or all elements of the signal conversion unit, for example, some or all elements of the differential circuit, constant current circuit and / or converter circuit as described above.
[0182] The second chip 920 may be primarily a logic chip (digital chip) that includes elements complementary to the elements on the first chip 910 to complete the pixel circuit and / or the signal conversion unit. The second chip 920 may also include an analog circuit, for example, a circuit that quantizes the analog signal transmitted from the first chip 910 via the TCV. For example, the second chip 920 may include all or at least a portion of the components of the ADC unit as described with reference to the previous figures.
[0183] The second chip 920 may have one or more pads BPD, and the first chip 910 may have an opening OPN for wire bonding to the second chip 920. The solid-state imaging device 23020 having a laminated structure of two chips 910, 920 may have the following characteristic configuration:
[0184] For example, the electrical connection between the first chip 910 and the second chip 920 is performed by TCV. TCV can be arranged at the chip end or between the pad area and the circuit area. TCV for transmitting control signals and power supply can be mainly concentrated at, for example, the four corners of the solid-state imaging device 23020, thereby reducing the signal wiring area of the first chip 910.
[0185] The technology according to the present disclosure can be implemented in a light receiving device installed in any type of mobile body (such as a car, electric vehicle, hybrid electric vehicle, motorcycle, bicycle, personal mobile body, airplane, drone, ship, or robot).
[0186] Fig.18 : is a block diagram describing an example of a schematic configuration of a vehicle control system as an example of a moving body control system to which the technology according to the embodiment of the present disclosure can be applied.
[0187] The vehicle control system 12000 includes a plurality of electronic control units connected to each other via a communication network 12001. Fig.12In the illustrated example, the vehicle control system 12000 includes a drive system control unit 12010, a body system control unit 12020, an exterior information detection unit 12030, an interior information detection unit 12040, and an integrated control unit 12050. In addition, a microcomputer 12051, a sound / image output section 12052, and an in-vehicle network interface 12053 are illustrated as a functional configuration of the integrated control unit 12050.
[0188] The drive system control unit 12010 controls the operation of devices related to the drive system of the vehicle according to various programs. For example, the drive system control unit 12010 is used as a control device for a drive force generating device (such as an internal combustion engine, a drive motor, etc.) for generating a drive force of the vehicle, a drive force transmitting mechanism that transmits the drive force to the wheels, a steering mechanism that adjusts the steering angle of the vehicle, a braking device that generates a braking force of the vehicle, etc.
[0189] The body system control unit 12020 controls the operation of various devices provided on the vehicle body according to various programs. For example, the body system control unit 12020 is used as a control device for a keyless entry system, a smart key system, a power window device, or various lights such as a headlight, a backup light, a brake light, a turn signal, a fog light, etc. In this case, a radio wave transmitted from a mobile device as a substitute for a key or a signal of various switches may be input to the body system control unit 12020. The body system control unit 12020 receives these input radio waves or signals, and controls the door lock device, the power window device, the lights, etc. of the vehicle.
[0190] The vehicle exterior information detection unit 12030 detects information about the exterior of the vehicle including the vehicle control system 12000. For example, the vehicle exterior information detection unit 12030 is connected to the imaging unit 12031. The vehicle exterior information detection unit 12030 causes the imaging unit 12031 to image the exterior of the vehicle and receives the imaged image. Based on the received image, the vehicle exterior information detection unit 12030 may perform a process of detecting an object such as a person, a vehicle, an obstacle, a sign, a character on a road surface, or a process of detecting a distance thereto, etc.
[0191] The imaging section 12031 may be or may include a solid-state imaging device including a signal conversion unit having a differential circuit according to an embodiment of the present disclosure. The light received by the imaging section 12031 may be visible light, or may be invisible light such as infrared rays.
[0192] The in-vehicle information detection unit 12040 detects information about the interior of the vehicle and may be or may include a solid-state imaging device with an original driver component according to an embodiment of the present disclosure. The in-vehicle information detection unit 12040 is connected to, for example, a driver state detection unit 12041 that detects the state of the driver. The driver state detection unit 12041 includes, for example, a camera that includes a solid-state imaging device and focuses on the driver. Based on the detection information input from the driver state detection unit 12041, the in-vehicle information detection unit 12040 can calculate the driver's fatigue or the driver's concentration, or can determine whether the driver is dozing off.
[0193] The microcomputer 12051 may calculate a control target value of a driving force generating device, a steering mechanism, or a braking device based on information about the vehicle interior or the vehicle exterior obtained by the vehicle exterior information detecting unit 12030 or the vehicle interior information detecting unit 12040, and output a control command to the driving system control unit 12010. For example, the microcomputer 12051 may perform cooperative control that is intended to implement functions of an advanced driver assistance system including collision prevention or shock absorption for the vehicle, follow-up driving based on a following distance, vehicle speed maintenance for driving, warning of vehicle collision, warning of vehicle deviation from a lane, and the like.
[0194] In addition, the microcomputer 12051 can perform collaborative control for automatic driving by controlling the driving force generating device, steering mechanism, braking device, etc. based on information about the outside or inside of the vehicle obtained by the outside information detection unit 12030 or the inside information detection unit 12040, thereby enabling the vehicle to drive autonomously without relying on the driver's operation, etc.
[0195] In addition, the microcomputer 12051 can output a control command to the body system control unit 12020 based on information about the outside of the vehicle (obtained by the vehicle exterior information detection unit 12030). For example, the microcomputer 12051 can perform cooperative control aimed at preventing glare by controlling the headlights to change from high beam to low beam according to the position of the front or oncoming vehicle detected by the vehicle exterior information detection unit 12030.
[0196] The sound / image output unit 12052 sends an output signal of at least one of sound and image to an output device capable of visually or auditorily notifying the vehicle occupants or the outside of the vehicle of information. Fig.18 In the example of FIG. 1 , an audio speaker 12061, a display portion 12062, and an instrument panel 12063 are shown as output devices. For example, the display portion 12062 may include at least one of an onboard display and a head-up display, each of which may include a solid-state imaging device with a comparison circuit as described with reference to the previous figures.
[0197] Fig.19 12101 , 12102 , 12103 , 12109 , and 12105 .
[0198] The imaging units 12101, 12102, 12103, 12109 and 12105 are, for example, arranged at positions on the front nose, side mirrors, rear bumper and rear door of the vehicle 12100 and at the upper position of the windshield inside the vehicle. The imaging unit 12101 arranged at the front nose and the imaging unit 12105 arranged at the upper part of the windshield inside the vehicle mainly obtain images of the front of the vehicle 12100. The imaging units 12102 and 12103 arranged at the side mirrors mainly obtain images of the sides of the vehicle 12100. The imaging unit 12109 arranged at the rear bumper or rear door mainly obtains images of the rear of the vehicle 12100. The imaging unit 12105 arranged at the upper part of the windshield inside the vehicle is mainly used to detect vehicles ahead, pedestrians, obstacles, signals, traffic signs, lanes, etc.
[0199] By the way, Fig.19 An example of the shooting range of the imaging units 12101 to 12109 is described. The imaging range 12111 indicates the imaging range of the imaging unit 12101 provided at the front nose. The imaging ranges 12112 and 12113 respectively indicate the imaging ranges of the imaging units 12102 and 12103 provided at the side mirrors. The imaging range 12114 indicates the imaging range of the imaging unit 12109 provided at the rear bumper or the rear door. For example, by overlapping the image data imaged by the imaging units 12101 to 12109, a bird's-eye view image of the vehicle 12100 viewed from above is obtained.
[0200] At least one of the imaging units 12101 to 12109 may have a function of obtaining distance information. For example, at least one of the imaging units 12101 to 12109 may be a stereo camera composed of a plurality of imaging elements having pixels for phase difference detection, or may include a ToF module including a high dynamic range image sensor including a signal conversion unit having a differential circuit according to the present disclosure.
[0201] For example, the microcomputer 12051 can determine the distance to each three-dimensional object within the imaging ranges 12111 to 12114 and the time change of the distance (relative speed relative to the vehicle 12100) based on the distance information obtained from the imaging units 12101 to 12109, and thereby extract the nearest three-dimensional object as the leading vehicle, which specifically exists on the driving path of the vehicle 12100 and travels at a predetermined speed (e.g., equal to or greater than 0 km / hour) in the same direction as the vehicle 12100. In addition, the microcomputer 12051 can pre-set the following distance to keep ahead of the leading vehicle, and perform automatic braking control (including follow-up stop control), automatic acceleration control (including follow-up start control), etc. Therefore, cooperative control for automatic driving can be performed, which allows the vehicle to travel autonomously without relying on the driver's operation, etc.
[0202] For example, the microcomputer 12051 can classify the three-dimensional object data related to the three-dimensional object into three-dimensional object data of two-wheeled vehicles, standard vehicles, large vehicles, pedestrians, utility poles and other three-dimensional objects based on the distance information obtained from the imaging units 12101 to 12109, extract the classified three-dimensional object data, and use the extracted three-dimensional object data for automatic obstacle avoidance. For example, the microcomputer 12051 identifies obstacles around the vehicle 12100 as obstacles that can be visually recognized by the driver of the vehicle 12100 and obstacles that are difficult for the driver of the vehicle 12100 to visually recognize. Then, the microcomputer 12051 determines the collision risk, which indicates the risk of collision with each obstacle. In the case where the collision risk is equal to or higher than the set value and therefore there is a possibility of collision, the microcomputer 12051 outputs a warning to the driver via the audio speaker 12061 or the display unit 12062, and performs forced deceleration or evasive steering via the driving system control unit 12010. The microcomputer 12051 can thereby assist driving to avoid collisions.
[0203] At least one of the imaging units 12101 to 12109 may be an infrared camera that detects infrared rays. The microcomputer 12051 may, for example, identify a pedestrian by determining whether a pedestrian exists in the imaging images of the imaging units 12101 to 12109. This identification of pedestrians is performed, for example, by a process of extracting feature points in the imaging images of the imaging units 12101 to 12109 as infrared cameras and a process of determining whether an obstacle is a pedestrian by performing pattern matching processing on a series of feature points representing the outline of the object. When the microcomputer 12051 determines that a pedestrian exists in the imaging images of the imaging units 12101 to 12109 and thus identifies the pedestrian, the sound / image output unit 12052 controls the display unit 12062 so that a square outline for emphasis is displayed as superimposed on the identified pedestrian. The sound / image output unit 12052 may also control the display unit 12062 so that an icon representing a pedestrian or the like is displayed at a desired position.
[0204] An example of a vehicle control system to which the technology according to an embodiment of the present disclosure is applicable has been described above. By applying an image sensor including a signal conversion unit having a differential circuit according to the present disclosure, power consumption can be further improved and sensor reaction time can be improved.
[0205] In addition, the embodiment of the present technology is not limited to the above-described embodiment, but various changes can be made within the scope of the present technology without departing from the gist of the present technology.
[0206] A solid-state imaging device including an image sensor assembly including a signal conversion unit having a differential circuit according to the present disclosure may be any device for analyzing and / or processing radiation such as visible light, infrared light, ultraviolet light, and X-rays. For example, the solid-state imaging device may be any electronic device in the fields of transportation, household appliances, medical and health care, security, beauty, sports, agriculture, image reproduction, eye tracking, structured light appliances, and the like.
[0207] Specifically, in the field of eye tracking, image sensors are typically operated at high frame rates above 200 Hz due to the rapid movement of the eye and the necessary optical flow accuracy. The image sensor with a conversion circuit based on a differential circuit described in this application can reduce sensing and processing power by reducing the number and range of AD conversions and producing sparser but still valuable information. Frame differentiation in the digital domain can be reduced or completely omitted.
[0208] In a structured light system, laser pulses are scanned across a scene at high speed. The image sensor that observes the scanned scene must be fast enough to reliably detect the reflected laser light. Compared to other CIS sensors, this embodiment, especially the reference 9A to 16BThe embodiments described allow a significant increase in speed. Due to the compact size of the pixel circuit comprising only four to five transistors, a high resolution can be obtained.
[0209] In the field of image reproduction, the solid-state imaging device may be a device for capturing images for appreciation, such as a digital camera, a smart phone, or a mobile phone device with a camera function. In the field of transportation, for example, the solid-state imaging device may be integrated into a vehicle-mounted sensor that captures the front, rear, periphery, interior, etc. of a vehicle for safe driving (such as automatic stopping, identifying the driver's state, etc.), integrated into a monitoring camera that monitors a moving vehicle and a road, or integrated into a distance measurement sensor that measures the distance between vehicles, etc.
[0210] In the field of household appliances, the solid-state imaging device can be integrated in any type of sensor that can be used in devices provided for household appliances (such as TV receivers, refrigerators, and air conditioners) to capture a user's gesture and perform device operations according to the gesture. Therefore, the solid-state imaging device can be integrated in household appliances such as TV receivers, refrigerators, and air conditioners and / or in devices that control household appliances. In addition, in the field of medical care and health care, the solid-state imaging device can be integrated in any type of sensor, for example, a solid-state imaging device for medical care and health care, such as an endoscope or a device that performs angiography by receiving infrared light.
[0211] In the field of security, solid-state imaging devices can be integrated into devices for security purposes, such as surveillance cameras for crime prevention or cameras for personal authentication. In addition, in the field of beauty, solid-state imaging devices can be used in devices for beauty purposes, such as skin measurement instruments that capture skin or microscopes that capture probes. In the field of sports, solid-state imaging devices can be integrated into devices for sports purposes, such as action cameras or wearable cameras for sports purposes. In addition, in the field of agriculture, solid-state imaging devices can be used in devices for agricultural purposes, such as cameras for monitoring the conditions of fields and crops.
[0212] This technology can also be configured as follows:
[0213] (1) A solid-state imaging device, comprising: a pixel circuit, wherein each pixel circuit is configured to output a pixel signal on a data signal line in response to an activated row selection signal within a row selection interval, wherein each pixel circuit includes a floating diffusion region, and wherein a floating diffusion potential of the floating diffusion region determines a voltage level of the pixel signal; and a differential circuit, configured to receive, for each pixel circuit, two pixel signals continuously transmitted from the pixel circuit on the data signal line within the same row selection interval, and obtain a differential signal from the two pixel signals, wherein the solid-state imaging device is configured to control each pixel circuit to output a previous pixel signal and a new pixel signal within the same row selection interval, and wherein the previous pixel signal and the new pixel signal contain image information related to imaging scenes at different time points.
[0214] (2) A solid-state imaging device according to (1), wherein the solid-state imaging device is configured to control the floating diffusion region to maintain the floating diffusion potential from the start of reading out a new pixel signal within a first row selection interval of the pixel circuit until the end of reading out a previous pixel signal within a second row selection interval of the pixel circuit.
[0215] (3) A solid-state imaging device according to any one of (1) to (2), wherein the differential circuit includes an amplifier circuit, a sampling capacitor between a data signal line in a first input branch and an inverting input terminal of the amplifier circuit, and a switchable feedback path between an output terminal of the amplifier circuit and an inverting input terminal of the amplifier circuit.
[0216] (4) A solid-state imaging device according to (3), wherein the solid-state imaging device is configured to control the differential circuit to sample a voltage corresponding to a signal level of a first pixel signal across a sampling capacitor in a first stage, and to obtain a differential signal from a difference between the voltage sampled at the sampling capacitor and a voltage level of a second pixel signal applied to an input electrode of the sampling capacitor in a second stage.
[0217] (5) A solid-state imaging device according to (3), wherein the solid-state imaging device is configured to control a differential circuit to sample a voltage corresponding to a signal level of a previous pixel signal across a sampling capacitor in a first stage, and to obtain a differential signal from a difference between the voltage sampled at the sampling capacitor and a voltage level of a next pixel signal applied to an input electrode of the sampling capacitor in a second stage, wherein the previous pixel signal and the new pixel signal contain image information related to imaging scenes at different time points.
[0218] (6) The solid-state imaging device according to any one of (1) to (5), further including: a noise reduction circuit configured to reduce kTC noise in the pixel signal before obtaining the differential signal.
[0219] (7) A solid-state imaging device according to any one of (1) to (6), wherein the differential circuit includes a fully differential amplifier and a sampling / holding circuit electrically connected between a data signal line in a first input branch and a first input terminal of the fully differential amplifier, and wherein a second input branch couples the data signal line and a second input terminal of the fully differential amplifier.
[0220] (8) The solid-state imaging device according to (7), further comprising: a first sampling capacitor in a portion of the first input branch located between the sample / hold circuit and the first input terminal of the differential amplifier circuit, a second sampling capacitor between the data signal line in the second input branch and the second input terminal of the differential amplifier circuit, a first gain capacitor between the second amplifier output terminal and the first amplifier input terminal in the first feedback path, and a second gain capacitor between the first amplifier output terminal and the second amplifier input terminal in the second feedback path.
[0221] (9) A solid-state imaging device according to any one of (1) to (8), wherein the pixel circuit further includes a photoelectric conversion element and a transfer transistor, wherein the photoelectric conversion element is configured to determine a floating diffusion potential by a photocurrent, and the transfer transistor is configured to connect a cathode of the photoelectric conversion element with a floating diffusion region in response to an activated transfer signal within a row selection interval.
[0222] (10) The solid-state imaging device according to (9), wherein the pixel circuit further includes a photodetector reset transistor configured to reset the potential at the cathode of the photoelectric conversion element to a fixed potential in response to an activated photodetector reset signal.
[0223] (11) A solid-state imaging device according to any one of (1) to (10), wherein the pixel circuit further includes a floating diffusion reset transistor, which is configured to connect the floating diffusion region to a pixel reset voltage at least in response to an activated floating diffusion reset signal, and wherein the pixel circuit further includes an auxiliary transistor and a pixel coupling capacitor, the auxiliary transistor being electrically connected in series between the floating diffusion reset transistor and a node providing the pixel reset voltage and being configured to connect the floating diffusion reset transistor to the node providing the pixel reset voltage in response to an activated auxiliary signal, and the pixel coupling capacitor being electrically connected in parallel to the floating diffusion reset transistor.
[0224] (12) A solid-state imaging device according to any one of (1) to (11), wherein the pixel circuit further includes a floating diffusion reset transistor, which is configured to connect the floating diffusion region to a pixel reset voltage at least in response to an activated floating diffusion reset signal, and the pixel circuit further includes a threshold drift compensation circuit, which is configured to control the pixel reset voltage according to the current voltage of the pixel signal on the data signal line.
[0225] (13) The solid-state imaging device according to any one of (1) to (12), further including: a converter circuit configured to gate the differential signal using a threshold signal.
[0226] (14) The solid-state imaging device according to (13), wherein the converter circuit is configured to obtain the digital event information from the differential signal.
[0227] (15) A solid-state imaging device according to any one of (13) to (14), wherein the converter circuit includes an analog-to-digital converter, and wherein the solid-state imaging device is configured to control the analog-to-digital converter so that the differential signal is quantized with high precision only when the differential signal is higher than a predefined frame differential threshold after k quantization steps out of N possible quantization steps.
[0228] (16) A solid-state imaging device according to any one of (1) to (2) and (6) to (12), wherein the differential circuit includes an amplifier circuit, a sampling capacitor between a data signal line in a first input branch and an inverting input terminal of the amplifier circuit, and an automatic zeroing switch element between an output terminal of the amplifier circuit and an inverting input terminal of the amplifier circuit, and wherein the differential circuit is configured to receive a variable threshold signal at a non-inverting input terminal of the amplifier circuit.
[0229] (17) The solid-state imaging device according to (16), further comprising: a ramp generator configured to apply a voltage ramp to a non-inverting input terminal of the amplifier circuit.
Claims
1. A solid-state imaging device, comprising: Pixel circuits (100), wherein each pixel circuit (100) is configured to output a pixel signal (Vout) on a data signal line (VSL) in response to an activated row selection signal (SEL) within a row selection interval, wherein each pixel circuit (100) includes a floating diffusion region (FD), and wherein a floating diffusion potential (Vfd) of the floating diffusion region (FD) determines a voltage level of the pixel signal (Vout); and A differential circuit (200) configured to receive, for each of the pixel circuits (100), two pixel signals continuously transmitted from the pixel circuit (100) on the data signal line (VSL) within the same row selection interval, and obtain a differential signal (Vrd) from the two pixel signals, The solid-state imaging device (90) is configured to control each pixel circuit (100) to output a previous pixel signal and a new pixel signal within the same row selection interval, and the previous pixel signal and the new pixel signal contain image information related to imaging scenes at different time points.
2. The solid-state imaging device according to claim 1, in, The solid-state imaging device (90) is configured to control the floating diffusion region (FD) to maintain a floating diffusion potential (Vfd) from the start of reading out a new pixel signal within a first row selection interval of the pixel circuit (100) until the end of reading out a previous pixel signal within a second row selection interval of the pixel circuit (100).
3. The solid-state imaging device according to claim 1, in, The differential circuit (200) comprises an amplifier circuit (205, 217), a sampling capacitor (201, 211) between the data signal line (VSL) in a first input branch and an inverting input of the amplifier circuit (205, 217), and a switchable feedback path (202) between an output of the amplifier circuit (205, 217) and the inverting input of the amplifier circuit (205, 217).
4. The solid-state imaging device according to claim 3, in, The solid-state imaging device (90) is configured to control the differential circuit (200) to sample a voltage corresponding to a signal level of a first pixel signal across the sampling capacitor (201) in a first stage, and to obtain the differential signal (Vrd) from a difference between the voltage sampled at the sampling capacitor (201) and a voltage level of a second pixel signal applied to an input electrode of the sampling capacitor (201) in a second stage.
5. The solid-state imaging device according to claim 3, in, The solid-state imaging device (90) is configured to control the differential circuit (200) to sample a voltage corresponding to a signal level of a previous pixel signal across the sampling capacitor (201) in a first stage, and to obtain the differential signal (Vrd) from a difference between the voltage sampled at the sampling capacitor (201) and a voltage level of a next pixel signal applied to an input electrode of the sampling capacitor (201) in a second stage, wherein the previous pixel signal and the new pixel signal contain image information related to imaging scenes at different time points.
6. The solid-state imaging device according to claim 1, further comprising: The noise reduction circuit is configured to reduce kTC noise in the pixel signal before obtaining the differential signal (Vrd).
7. The solid-state imaging device according to claim 1, in, The differential circuit (200) comprises a fully differential amplifier (217) and a sampling / holding circuit (218) electrically connected between the data signal line (VSL) in a first input branch and a first input terminal of the fully differential amplifier (217), and wherein a second input branch couples the data signal line (VSL) and a second input terminal of the fully differential amplifier (217).
8. The solid-state imaging device according to claim 7, further comprising: A first sampling capacitor (211) in a portion of the first input branch between the sample / hold circuit (218) and the first input terminal of the differential amplifier circuit (217), a second sampling capacitor (311) between the data signal line (VSL) of the second input branch and the second input terminal of the differential amplifier circuit (217), a first gain capacitor (213) between the second amplifier output terminal and the first amplifier input terminal in a first feedback path, and a second gain capacitor (313) between the first amplifier output terminal and the second amplifier input terminal in a second feedback path.
9. The solid-state imaging device according to claim 1, in, The pixel circuit (100) further comprises a photoelectric conversion element (PD) configured to determine the floating diffusion potential (Vfd) by a photocurrent and a transfer transistor (101) configured to connect a cathode of the photoelectric conversion element (PD) and the floating diffusion region (FD) in response to an activated transfer signal (TG) within the row selection interval.
10. The solid-state imaging device according to claim 9, in, The pixel circuit (100) further includes a photodetector reset transistor (104) configured to reset a potential at a cathode of the photoelectric conversion element (PD) to a fixed potential in response to an activated photodetector reset signal (PDR).
11. The solid-state imaging device according to claim 1, in, The pixel circuit (100) further comprises a floating diffusion reset transistor (102) configured to connect the floating diffusion region (FD) to a pixel reset voltage (Vres) in response to at least an activated floating diffusion reset signal (FDR), and The pixel circuit (100) further includes an auxiliary transistor (321) and a pixel coupling capacitor (323), wherein the auxiliary transistor is electrically connected in series between the floating diffusion reset transistor (102) and a node providing the pixel reset voltage (Vres) and is configured to connect the floating diffusion reset transistor (102) to the node providing the pixel reset voltage (Vres) in response to an activated auxiliary signal (AXR), and the pixel coupling capacitor is electrically connected in parallel to the floating diffusion reset transistor (102).
12. The solid-state imaging device according to claim 1, in, The pixel circuit (100) further comprises a floating diffusion reset transistor (102), the floating diffusion reset transistor being configured to connect the floating diffusion region (FD) to a pixel reset voltage (Vres) in response to at least an activated floating diffusion reset signal (FDR), and the pixel circuit (100) further comprises: The threshold shift compensation circuit (330) is configured to control the pixel reset voltage (Vres) according to the current voltage of the pixel signal (Vout) on the data signal line (VSL).
13. The solid-state imaging device according to claim 1, further comprising: The converter circuit (400) is configured to select the differential signal (Vrd) using a threshold signal.
14. The solid-state imaging device according to claim 13, in, The converter circuit (400) is configured to obtain digital event information (EV) from the differential signal (Vrd).
15. The solid-state imaging device according to claim 13, in, The converter circuit (400) comprises an analog-to-digital converter (430), and wherein the solid-state imaging device (90) is configured to control the analog-to-digital converter (430) so that the differential signal (Vrd) is quantized with high precision only when the differential signal (Vrd) is above a predefined frame differential threshold after k quantization steps out of N possible quantization steps.
16. The solid-state imaging device according to claim 1, in, The differential circuit (200) comprises an amplifier circuit (205), a sampling capacitor (201) between the data signal line (VSL) in a first input branch and an inverting input terminal of the amplifier circuit (205), and an auto-zero switch element (204) between an output terminal of the amplifier circuit (205) and the inverting input terminal of the amplifier circuit (205), and wherein the differential circuit (200) is configured to receive a variable threshold signal (Vthr) at a non-inverting input terminal of the amplifier circuit (205).
17. The solid-state imaging device according to claim 16, further comprising: A ramp generator (461) is configured to apply a voltage ramp to the non-inverting input terminal of the amplifier circuit (205).
