Photoelectric conversion device, electronic instrument, and substrate
By introducing a differential circuit and an ΔΣ analog-to-digital conversion circuit in the photoelectric conversion device, the difference in signal charge is solved, and the problems of signal readout efficiency and dynamic range limitation in the prior art are achieved, and an efficient HDR imaging effect is achieved.
Patent Information
- Application Number
- CN202410661046.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-05-29
- Filing Date
- 2024-05-27
- Publication Date
- 2024-11-29
AI Technical Summary
The existing photoelectric conversion devices have signal readout efficiency and dynamic range limitations when processing signals, making it difficult to meet the needs of high dynamic range (HDR) imaging.
A photoelectric conversion device is designed, including a photoelectric conversion unit, a differential circuit and an oversampling conversion circuit. By performing differential processing and analog-to-digital conversion on the signal charge, a third signal indicating the difference between the signals is generated, and ΔΣ analog-to-digital conversion is used. The circuit performs high-precision analog-to-digital conversion to realize differential readings of signals of different accumulation time.
It improves the signal readout efficiency and dynamic range of the photoelectric conversion device, reduces noise and power consumption, enhances image quality, and is suitable for HDR imaging.
Smart Images

Figure CN119052667A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a photoelectric conversion device, an electronic instrument and a substrate. Background Art
[0002] International Publication No. 2019 / 069614 describes a solid-state imaging device including a ΔΣ analog-to-digital conversion circuit. In the solid-state imaging device described in International Publication No. 2019 / 069614, a differential process is performed between a data signal sampled by a data signal sampling and holding circuit and a reset signal sampled by a reset signal sampling and holding circuit. Summary of the invention
[0003] Some embodiments of the present invention provide techniques that are useful for improving the usability of photoelectric conversion devices.
[0004] According to some embodiments, a photoelectric conversion device is provided, which includes: a photoelectric conversion unit configured to receive incident light; a differential circuit configured to receive a first signal and a second signal and output a third signal indicating a difference between the first signal and the second signal, the first signal and the second signal being signals respectively corresponding to signal charges generated by the photoelectric conversion unit based on the incident light; and an oversampling conversion circuit configured to perform analog-to-digital conversion on the third signal.
[0005] According to some other embodiments, a substrate is provided, which is stacked on a substrate equipped with a photoelectric conversion unit, and the photoelectric conversion unit is configured to receive incident light. The substrate includes: a differential circuit, which is configured to receive a first signal and a second signal, and output a third signal indicating the difference between the first signal and the second signal, the first signal and the second signal being signals respectively corresponding to signal charges generated by the photoelectric conversion unit based on the incident light; and an oversampling conversion circuit, which is configured to perform analog-to-digital conversion on the third signal.
[0006] Further features of the present invention will become apparent from the following description of exemplary embodiments (with reference to the attached drawings). BRIEF DESCRIPTION OF THE DRAWINGS
[0007] Figure 1 is a diagram showing an example of arrangement of a photoelectric conversion device according to an embodiment;
[0008] Figure 2 It is shown Figure 1 A diagram showing an example of arrangement of pixels of a photoelectric conversion device shown;
[0009] Figure 3 It is shown Figure 1 A diagram showing an example of arrangement of a sample-hold unit and a conversion circuit of a photoelectric conversion device shown in FIG.
[0010] Figure 4It is shown Figure 1 A timing chart showing an example of the operation of the photoelectric conversion device shown;
[0011] Figure 5 It is shown Figure 1 A diagram showing an example of arrangement of pixels of a photoelectric conversion device shown;
[0012] Figure 6 It is shown Figure 1 A timing chart showing an example of the operation of the photoelectric conversion device shown; and
[0013] Figure 7 is a diagram showing an arrangement example of a camera including a photoelectric conversion device according to the embodiment. DETAILED DESCRIPTION
[0014] Hereinafter, the embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments are not intended to limit the scope of the present invention. A plurality of features are described in the embodiments, but are not limited to the invention requiring all of these features, and these features may be appropriately combined. In addition, in the accompanying drawings, the same reference numerals are given to the same or similar configurations, and redundant descriptions thereof are omitted.
[0015] Reference Figures 1 to 6 , a photoelectric conversion device according to an embodiment of the present disclosure will be described. Figure 1 is a schematic diagram showing an arrangement example of a photoelectric conversion device 1000 according to the present disclosure. Figure 2 is a diagram showing an arrangement example of pixels 10 arranged in the photoelectric conversion device 1000 . Figure 3 is a diagram showing an arrangement example of a sample-and-hold unit 50 arranged in the photoelectric conversion apparatus 1000 and a conversion circuit 60 configured to perform analog-to-digital conversion. Figure 4 is a timing chart showing an operation example of the photoelectric conversion apparatus 1000 .
[0016] The photoelectric conversion device 1000 includes a pixel substrate 1 and a circuit substrate 2, the pixel substrate 1 is a substrate on which a plurality of pixels 10 (photoelectric conversion elements 400) are arranged, and the circuit substrate 2 is a substrate on which a circuit for operating the pixels 10 is arranged. The photoelectric conversion device 1000 may have a stacked chip structure in which the pixel substrate 1 and the circuit substrate 2 are stacked on each other. The pixel substrate 1 includes a photoelectric conversion unit 5 on which a plurality of pixels 10 (photoelectric conversion elements 400) are arranged. The circuit substrate 2 is formed by including a current source 40, a sampling and holding unit 50, a conversion circuit 60, a data processing circuit 90, and an output unit 100.
[0017] In the photoelectric conversion unit 5 that receives incident light, a plurality of pixels 10 are arranged in a matrix, each of which includes a photoelectric conversion element 400. Here, the row direction indicates Figure 1 The horizontal direction in the Figure 1 The pixel 10 generates charges corresponding to the incident light.
[0018] In the photoelectric conversion unit 5, vertical signal lines 30 are arranged along a column direction corresponding to each pixel column where pixels 10 are arranged. The vertical signal lines 30 transmit signals based on charges generated by the photoelectric conversion elements 400 arranged in the pixels 10 from the pixels 10 to the sample holding unit 50.
[0019] The current source 40 is arranged corresponding to each vertical signal line 30. The current source 40 supplies a bias current for reading out a signal to the pixel 10 selected as the pixel for reading out a signal via the vertical signal line 30.
[0020] The sampling and holding unit 50 samples and holds a signal generated by the photoelectric conversion element 400 arranged in each pixel 10 from the photoelectric conversion unit 5 via the vertical signal line 30. In the present embodiment, in the sampling and holding unit 50, two sampling and holding circuits are connected to one vertical signal line 30. This will be described in detail later.
[0021] The conversion circuit 60 performs analog-to-digital conversion on the signal output from the sampling and holding unit 50. The conversion circuit 60 is arranged corresponding to each vertical signal line 30. An oversampling analog-to-digital converter such as a ΔΣ analog-to-digital conversion circuit can be used as the conversion circuit 60 that performs the analog-to-digital conversion. However, the present invention is not limited thereto, and a slope analog-to-digital conversion circuit, a successive approximation type analog-to-digital conversion circuit, or the like can be used as the conversion circuit 60.
[0022] The data processing circuit 90 is a digital signal processing circuit that processes the digital signal output from the conversion circuit 60. For example, the data processing circuit 90 can perform correction processing, interpolation processing, etc. on the digital signal output from the conversion circuit 60. The output circuit 100 outputs the signal processed by the data processing circuit 90 to the outside of the photoelectric conversion device 1000.
[0023] like Figure 2As shown, the pixel 10 may include a photoelectric conversion element 400, a transfer transistor 410, a reset transistor 455, an amplifier transistor 430, and a selection transistor 440. The photoelectric conversion element 400 may be, for example, a photodiode. One of the two main electrodes of the photoelectric conversion element 400 is connected to the ground potential 450. The photoelectric conversion element 400 photoelectrically converts the received light into a signal charge (e.g., photoelectrons) of a charge amount corresponding to the amount of the received light, and accumulates the signal charge. The other of the two main electrodes of the photoelectric conversion element 400 is connected to the gate electrode of the amplifier transistor 430 via the transfer transistor 410. The node 420 electrically connected to the gate electrode of the amplifier transistor 430 serves as a floating diffusion node. The floating diffusion node is a charge voltage conversion unit that converts the signal charge generated by the photoelectric conversion element 400 into a signal voltage. Here, a plurality of pixels 10 are arranged in the photoelectric conversion unit 5. Therefore, it can also be said that a plurality of photoelectric conversion elements 400 and a plurality of floating diffusion nodes corresponding to the plurality of photoelectric conversion elements 400 are arranged in the photoelectric conversion unit 5.
[0024] A control signal TX is supplied to the gate electrode of the transfer transistor 410. When the transfer transistor 410 is set to an ON state according to the control signal TX, signal charges photoelectrically converted by and accumulated in the photoelectric conversion element 400 are transferred to the node 420 serving as a floating diffusion node.
[0025] The reset transistor 455 is connected between the power supply potential 460 and the node 420. The expression "the transistor is connected between A and B" here means a state in which one of the two main electrodes (source and drain) of the transistor is connected to A and the other of the two main electrodes is connected to B. In this case, the gate electrode of the transistor is not connected to A or B.
[0026] A control signal RES is supplied to the gate electrode of the reset transistor 455. When the reset transistor 455 is set to an ON state according to the control signal RES, the potential of the node 420 serving as a floating diffusion node is reset to the power supply potential 460, and the charge held by the floating diffusion node is cleared.
[0027] The amplifier transistor 430 is connected between the power supply potential 460 and the selection transistor 440. The gate electrode of the amplifier transistor 430 is connected to the node 420. The amplifier transistor 430 forms an input portion of a source follower that reads out a signal obtained from the photoelectric conversion of the photoelectric conversion element 400. That is, one of the two main electrodes of the amplifier transistor 430 is connected to the vertical signal line 30 via the selection transistor 440. The amplifier transistor 430 and the current source 40 connected to the vertical signal line 30 form a source follower that converts the voltage of the node 420 into the potential of the vertical signal line 30.
[0028] The selection transistor 440 is connected between the amplification transistor 430 and the vertical signal line 30. A control signal SEL is supplied to the gate electrode of the selection transistor 440. When the selection transistor 440 is set to an ON state according to the control signal SEL, the pixel 10 is set to a selection state, and a signal is output from the amplification transistor 430 to the vertical signal line 30.
[0029] The circuit arrangement of the pixel 10 is not limited to Figure 2 For example, the selection transistor 440 may be connected between the power supply potential 460 and the amplification transistor 430 . Figure 2 The arrangement shown shows a so-called four-transistor arrangement including a transfer transistor 410, a reset transistor 455, an amplifying transistor 430, and a selecting transistor 440 as a pixel 10. However, the pixel 10 is not limited thereto. For example, the selecting transistor 440 in the pixel 10 may be omitted, and the pixel 10 may have a three-transistor arrangement as follows, in which the amplifying transistor 430 is also used as a selecting transistor. Alternatively, the pixel 10 may have an arrangement with an increased number of transistors, such as an arrangement including five or more transistors. The pixel 10 may output: a reset signal obtained when the potential of the node 420 is reset by the reset transistor 455 to reset the photoelectric conversion element 400, and a data signal of a signal level obtained when the photoelectric conversion element 400 performs photoelectric conversion according to incident light.
[0030] Figure 3 An example of a circuit arrangement is shown with attention paid to the sampling and holding unit 50 and the conversion circuit 60 of the photoelectric conversion device 1000. Among the sampling and holding unit 50 and the conversion circuit 60, Figure 3 The sample-hold circuit and the analog-to-digital conversion circuit are shown to be arranged corresponding to one vertical signal line 30. As the sample-hold unit 50, two sample-hold circuits 210 and 211 for sampling and holding a reset signal and a data signal output from each pixel 10 for each pixel 10 are connected corresponding to one vertical signal line 30. In addition, one conversion circuit 60 is connected corresponding to one vertical signal line 30.
[0031] The sample-hold circuit 210 includes: capacitor elements 120 and 123, and an inverting amplifier 220 used as an output amplifier shared by the capacitor elements 120 and 123. Switches 110 and 113 control the connection between the vertical signal line 30 and the capacitor elements 120 and 123 according to control signals Smp_n1 and Smp_n2. The inverting amplifier 220 can be formed by a combination of a common source circuit and a source follower circuit. The inverting amplifier 220 includes: transistors 130, 140, 150, 160 and 230, switches 170, 180, 190 and 193, and a current source 200. The switch 170 is connected between the input and output of the common source circuit formed by the transistors 130, 140, 150 and 160, and is controlled by the control signal Smpa_n. According to the control signal Hold_n, Hold_n1 or Hold_n2, the signal sampled by the sample-hold circuit 210 is output from the inverting amplifier 220.
[0032] The sample and hold circuit 211 may have an arrangement similar to that of the sample and hold circuit 210. The sample and hold circuit 211 includes: capacitive elements 121 and 122, and an inverting amplifier 221 used as an output amplifier shared by the capacitive elements 121 and 122. The switches 111 and 112 control the connection between the vertical signal line 30 and the capacitive elements 121 and 122 according to the control signals Smp_s1 and Smp_s2. The inverting amplifier 221 may be formed by a combination of a common source circuit and a source follower circuit. The inverting amplifier 221 includes: transistors 131, 141, 151, 161, and 231, switches 171, 181, 191, and 192, and a current source 201. The switch 171 is connected between the input and output of the common source circuit formed by the transistors 131, 141, 151, and 161, and is controlled by the control signal Smpa_s. The signal sampled by the sample-and-hold circuit 211 is output from the inverting amplifier 221 according to the control signal Hold_s, Hold_s1 or Hold_s2.
[0033] like Figure 3 As shown, a resistor element 240 is arranged between the output terminal of the sample and hold circuit 210 and the output terminal of the sample and hold circuit 211. Here, V1 is set as the potential of the output terminal of the sample and hold circuit 210, that is, the potential corresponding to the signal sampled by the sample and hold circuit 210. Similarly, V2 is set as the potential of the output terminal of the sample and hold circuit 211, that is, the potential corresponding to the signal sampled by the sample and hold circuit 211. In addition, R is set as the resistance value of the resistor element 240. Since the resistor element 240 is arranged between the output terminal of the sample and hold circuit 210 and the output terminal of the sample and hold circuit 211, the current I flowing through the resistor element 240 can be expressed by the following formula:
[0034] I=(V1-V2) / R
[0035] The current I is input to the conversion circuit 60 .
[0036] In this case, the current I flowing through the resistor element 240 is proportional to the difference between the potential V1 of the output terminal of the sample and hold circuit 210 and the potential V2 of the output terminal of the sample and hold circuit 211. Therefore, it can also be said that the resistor element 240 generates a current corresponding to the signal voltage difference between the signal held by the sample and hold circuit 210 and the signal held by the sample and hold circuit 211 as a signal supplied to the conversion circuit 60. Therefore, the resistor element 240 is used as a differential circuit in the sample and hold unit 50 for outputting a signal indicating the difference between the signal held by the sample and hold circuit 210 and the signal held by the sample and hold circuit 211. For example, the above-mentioned reset signal is sampled by the sample and hold circuit 210, and the data signal is sampled by the sample and hold circuit 211. As described above, since the current I flowing through the resistor element 240 is proportional to the difference between the potential V1 of the output terminal of the sample and hold circuit 210 and the potential V2 of the output terminal of the sample and hold circuit 211, correlated double sampling (CDS) is performed at the stage where the current I is input to the conversion circuit 60. The conversion circuit 60 performs analog-to-digital conversion on a signal (current) indicating a difference between a signal held by the sample-and-hold circuit 210 and a signal held by the sample-and-hold circuit 211 .
[0037] In the present embodiment, the conversion circuit 60 as a ΔΣ analog-to-digital conversion circuit includes a first integrator, a second integrator, a quantizer 370, and a decimation filter 380. In the conversion circuit 60, the first integrator is formed by an integration capacitor 320. The second integrator is formed by an integration capacitor 360 and a Gm unit 330 that converts a voltage into a current. A digital-to-analog converter 305 including a current source 300 and a switch 310 is connected to an input node of the first integrator. The digital-to-analog converter 305 controls the current flowing to the first integrator according to a digital signal via the second integrator and the quantizer 370. A digital-to-analog converter 345 including a current source 340 and a switch 350 is connected to the input node of the second integrator. The digital-to-analog converter 345 controls the current of the second integrator according to the quantization result of the quantizer 370 as the output of the second integrator.
[0038] In the conversion circuit 60, the quantizer 370 performs the following operation: the previous quantization value is fed back to the second integrator and the first integrator through the digital-to-analog converters 305 and 345. In this way, a secondary noise shaping characteristic can be obtained by passing the previous quantization value twice through the integrator while feeding the previous quantization value back to the digital-to-analog converters 305 and 345. In addition, by removing high-frequency noise through the decimation filter 380 arranged at the post-stage of the quantizer 370, an analog-to-digital conversion output can be obtained with high accuracy.
[0039] Figure 4 An operation example of each switch of the sample-and-hold circuits 210 and 211 is shown. Figure 4 The waveforms of the control signals RES and TX of the pixel 10, the potential of the vertical signal line 30, and the control signals Smp_n1, Smp_n2, Smpa_n, Hld_n, Hld_n1, Hld_n2, Smp_s1, Smp_s2, Smpa_s, Hld_s, Hld_s1, and Hld_s2 of the switches of the sample-hold circuits 210 and 211 are shown. The description is given under the following assumptions: Figure 4 In the waveform shown, when the control signal is at a high level, the corresponding switch is in a conducting state; and when the control signal is at a low level, the corresponding switch is in a non-conducting state (OFF state). Figure 4 In the description, the operation of one pixel 10 (photoelectric conversion element 400) of interest will be described, but similar operations may be performed in each pixel 10 (photoelectric conversion element 400) arranged in the photoelectric conversion unit 5. In this case, the operation may be performed simultaneously in the pixels 10 (photoelectric conversion elements 400) arranged in the same row as the pixel 10 (photoelectric conversion element 400) of interest. Figure 4 Furthermore, similar operations may be sequentially performed for each row of pixels 10 (photoelectric conversion elements 400 ) arranged in the same column as the pixel 10 (photoelectric conversion element 400 ) of interest.
[0040] In the period from time t1 to time t2, Figure 2 The control signal RES shown in is set to a high level, and the reset transistor 455 is turned on to reset the node 420 serving as a floating diffusion node. According to the resetting of the node 420, the potential of the vertical signal line 30 is set to the level of the reset signal. In addition, at time t1, the control signals Smp_n1 and Smpa_n are set to a high level, and the switches 110 and 170 are turned on in the sample and hold circuit 210. Then, at time t3 when the control signal Smpa_n changes from a high level to a low level, the potential Vn of the reset signal is sampled and accumulated in the capacitor element 120 of the sample and hold circuit 210. Then, at time t4, the control signal Smp_n1 changes from a high level to a low level, the switch 110 is turned off, and the capacitor element 120 is disconnected from the vertical signal line 30. Here, although Figure 4 Although not shown in the figure, the following description will be made assuming that the photoelectric conversion element 400 is reset before time t1 and has accumulated charges corresponding to the incident light.
[0041] In the period from time t5 to time t6, Figure 2The control signal TX shown in is set to a high level, and the transfer transistor 410 is turned on, so that the charge is transferred from the photoelectric conversion element 400 to the node 420 used as a floating diffusion node. The potential of the node 420 decreases according to the amount of charge transferred from the photoelectric conversion element 400. Therefore, the potential of the vertical signal line 30 drops to the level of the first data signal. In addition, at time t5, the control signals Smp_s1 and Smpa_s are set to a high level, and the switches 111 and 171 are turned on in the sample and hold circuit 211. Then, at time t7 when the control signal Smpa_s changes from a high level to a low level, the potential Vs1 of the first data signal is sampled and accumulated in the capacitor element 121. Then, at time t8, the control signal Smp_s1 changes from a high level to a low level, the switch 111 is turned off, and the capacitor element 121 is disconnected from the vertical signal line 30.
[0042] Here, regardless of the potential of the vertical signal line 30, when the switch 171 is turned off at time t7, the voltage across the switch 171 is always approximately the same. Therefore, by the charge injection caused by turning off the switch 171, the gain component error in the potential Vs1 of the first data signal accumulated in the capacitor 121 can be suppressed. In addition, when the switch 111 is turned off at time t8, since both ends of the capacitor 121 are in a high impedance state, the influence of turning off the switch 111 is unlikely to occur. In this way, the gain error in the potential Vs1 of the first data signal can be suppressed.
[0043] In the above operation, at time t5, the control signals Smp_n2 and Smpa_n are set to a high level, and the switches 113 and 170 are turned on in the sample-and-hold circuit 210. Then, at time t7 when the control signal Smpa_n changes from a high level to a low level, the potential Vs1 of the first data signal is sampled and accumulated in the capacitance element 123. Then, at time t8, the control signal Smp_n2 changes from a high level to a low level, the switch 113 turns off, and the capacitance element 123 is disconnected from the vertical signal line 30. In this way, in the present embodiment, the potential Vs1 of the first data signal is also sampled in the capacitance element 123 in the sample-and-hold circuit 210.
[0044] In the period from time t9 to time t10, Figure 2The control signal TX shown is set to a high level again, and the transfer transistor 410 is turned on. In this way, the charge accumulated in the photoelectric conversion element 400 in the period from time t6 to time t10 is further transferred to the node 420 used as a floating diffusion node. The potential of the node 420 is further reduced according to the amount of charge. Therefore, the potential of the vertical signal line 30 is further reduced to the level of the second data signal. In addition, at time t9, the control signals Smp_s2 and Smpa_s are set to a high level, and the switches 112 and 171 are turned on in the sample-and-hold circuit 211. Then, at the time t11 when the control signal Smpa_s changes from a high level to a low level, the potential Vs2 of the second data signal is sampled and accumulated in the capacitor 122. Then, at time t12, the control signal Smp_s2 changes from a high level to a low level, the switch 112 is turned off, and the capacitor 122 is disconnected from the vertical signal line 30.
[0045] Here, regardless of the potential of the vertical signal line 30, when the switch 171 is turned off at time t11, the voltage across the switch 171 is always approximately the same. Therefore, by the charge injection caused by turning off the switch 171, the gain component error in the potential Vs2 of the second data signal accumulated in the capacitor 122 can be suppressed. In addition, when the switch 112 is turned off at time t12, since both ends of the capacitor 122 are in a high impedance state, the influence of turning off the switch 112 is unlikely to occur. In this way, the gain error in the potential Vs2 of the second data signal can be suppressed.
[0046] In this way, in the sample-hold unit 50, after the first transfer operation of transferring the charge from the photoelectric conversion element 400 to the node 420 serving as the floating diffusion node, and before the second transfer operation of transferring the charge from the same photoelectric conversion element 400 to the node 420 without resetting the node 420 after the first transfer operation, the first data signal based on the charge transferred to the floating diffusion node is sampled in the capacitance element 123 of the sample-hold circuit 210 and the capacitance element 121 of the sample-hold circuit 211. In addition, in the sample-hold unit 50, after the second transfer operation, the second data signal based on the charge transferred to the floating diffusion node is sampled in the capacitance element 122 of the sample-hold circuit 211. In addition, in the sample-hold unit 50, as described above, when the node 420 serving as the floating diffusion node is reset, the reset signal corresponding to the voltage of the reset node 420 is sampled and held in the capacitance element 120 of the sample-hold circuit 210.
[0047] Then, at time t13, control signals Hld_n1 and Hld_n are set to high level, and switches 180 and 190 are turned on. Thus, in the sample-and-hold circuit 210, the capacitor element 120 outputs the potential Vn of the reset signal. In addition, at the same time t13, control signals Hld_s1 and Hld_s are set to high level, and switches 181 and 191 are turned on. Thus, in the sample-and-hold circuit 211, the capacitor element 121 outputs the potential Vs1 of the first data signal.
[0048] As described above, a current corresponding to the difference between the potential Vn of the reset signal at the output end of the sample and hold circuit 210 and the potential Vs1 of the first data signal at the output end of the sample and hold circuit 211 is input to the conversion circuit 60. The conversion circuit 60 performs analog-to-digital conversion on the current corresponding to the difference between the potential Vn and the potential Vs1.
[0049] After the control signal Hld_n1 is set to a low level and the switch 190 is turned off at time t14, the control signal Hld_n2 is set to a high level and the switch 193 is turned on at time t15. Thus, in the sample-and-hold circuit 210, the capacitor element 123 outputs the potential Vs1 of the first data signal. Furthermore, after the control signal Hld_s1 is set to a low level and the switch 191 is turned off at time t14, the control signal Hld_s2 is set to a high level and the switch 192 is turned on at time t15. Thus, in the sample-and-hold circuit 211, the capacitor element 122 outputs the potential Vs2 of the second data signal.
[0050] Thus, a current corresponding to the difference between the potential Vs1 of the first data signal at the output end of the sample and hold circuit 210 and the potential Vs2 of the second data signal at the output end of the sample and hold circuit 211 is input to the conversion circuit 60. The conversion circuit 60 performs analog-to-digital conversion on the current corresponding to the difference between the potential Vs1 and the potential Vs2.
[0051] In the present embodiment, according to the analog-to-digital conversion result of the difference between the potential Vn of the reset signal and the potential Vs1 of the first data signal, a signal based on the charge generated by the photoelectric conversion element 400 according to the incident light during the accumulation time starting before time t1 and ending at time t6 can be obtained. In addition, according to the analog-to-digital conversion result of the difference between the potential Vs2 of the second data signal and the potential Vs1 of the first data signal, a signal based on the charge generated by the photoelectric conversion element 400 according to the incident light during the accumulation time from time t6 to time t10 can be obtained.
[0052] In this embodiment, not only a signal corresponding to the difference between the reset signal and the data signal can be obtained, but also a signal corresponding to the difference between the first data signal and the second data signal, which are respectively based on the charges generated according to the incident light, can be obtained. In this way, by obtaining the difference between the data signals and performing A / D conversion based on the difference between the data signals, for example, two signals with different accumulation times as described above can be read out. Signals with different accumulation times can be used, for example, for high dynamic range (HDR) imaging, so that the functionality of the photoelectric conversion device 1000 can be improved.
[0053] In addition, as described above, the gain error of the potentials Vs1 and Vs2 of the two data signals can be suppressed. In addition, since the capacitor 121 and the capacitor 122 are arranged in a sample-and-hold circuit 211 and share the inverting amplifier 221, the potentials Vs1 and Vs2 of the two data signals can be read out without increasing the operating power. Similarly, since the capacitor 120 and the capacitor 123 are arranged in a sample-and-hold circuit 210 and share the inverting amplifier 220, the potential Vn of the reset signal and the potential Vs1 of the first data signal can be read out without increasing the operating power. In addition, since the sample-and-hold circuit 210 includes capacitors 120 and 123, CDS can be performed on the potentials Vs1 and Vs2 of the two data signals sampled in the two capacitors 121 and 122.
[0054] In addition, by performing analog-to-digital conversion on the difference signal between the potential Vs2 of the second data signal and the potential Vs1 of the first data signal, noise can be reduced. For example, in the case where the difference is obtained after performing analog-to-digital conversion on each of the potential Vs2 of the second data signal and the potential Vs1 of the first data signal, the noise generated due to the analog-to-digital conversion is multiplied by √2. In other words, in the present embodiment, the noise caused by the analog-to-digital conversion is reduced by 1 / √2 compared to the case where the difference is obtained after the analog-to-digital conversion.
[0055] In addition, by performing analog-to-digital conversion on the difference between the potential Vs2 of the second data signal and the potential Vs1 of the first data signal, the power consumption of the photoelectric conversion device 1000 can be reduced. The signal amplitude of the potential Vs2 of the second data signal is greater than the signal amplitude of the potential Vs1 of the first data signal. Therefore, for example, when the difference between the potential Vs2 of the second data signal and the potential Vn of the reset signal is analog-to-digital converted, the voltage across the resistor element 240 becomes higher, and the current input to the conversion circuit 60 becomes larger. In this case, for example, it is necessary to increase the current value of the current source 300, resulting in increased power consumption. On the other hand, in the present embodiment, the difference between the potential Vs2 of the second data signal and the potential Vs1 of the first data signal is less than the difference between the potential Vs2 of the second data signal and the potential Vn of the reset signal. Therefore, when the difference between the potential Vs2 of the second data signal and the potential Vs1 of the first data signal is read out, the voltage across the resistor element 240 becomes lower, and the current input to the conversion circuit 60 becomes smaller. Therefore, the current value of the current source 300 can be reduced, so that power consumption can be reduced in the photoelectric conversion apparatus 1000 .
[0056] In addition, gain is applied to the potentials Vs1 and Vs2 of the two data signals by using the common resistance element 240. Therefore, gain fluctuations of the potentials Vs1 and Vs2 of the two data signals caused by temperature or process changes are likely to be synchronized in the same direction. Therefore, degradation of the image quality of the HDR image caused by different changes superimposed on the signals corresponding to the two different accumulation times can be suppressed.
[0057] Here, it has been described above that analog-to-digital conversion is performed after obtaining the difference value between two data signals obtained from one pixel 10 (photoelectric conversion element 400) among the multiple pixels 10 (photoelectric conversion element 400) arranged in the photoelectric conversion unit 5. However, the above operation is not limited to this. For example, the difference can be obtained for the data signal read out from the photoelectric conversion element 400 arranged in different pixels 10. The multiple photoelectric conversion elements 400 can form a plurality of photoelectric conversion element groups each including two or more photoelectric conversion elements. The sampling and holding unit 50 samples two or more data signals based on the charge generated according to the incident light in each photoelectric conversion element group in the multiple photoelectric conversion element groups for each photoelectric conversion element group in the multiple photoelectric conversion element groups. The pixels 10 arranged with the photoelectric conversion element 400 forming a photoelectric conversion element group (for which the difference between the data signals is obtained) can be, for example, pixels 10 adjacent to each other.
[0058] In the above description, the arrangement in which two capacitor elements 120 and 123 are arranged in the sample-and-hold circuit 210 and two capacitor elements 121 and 122 are arranged in the sample-and-hold circuit 211 is taken as an example. However, the present invention is not limited to this. For example, without arranging capacitor elements 122 and 123, capacitor elements 120 and capacitor elements 121 can hold the data signal read out from the photoelectric conversion element 400 arranged in the pixel 10 adjacent to each other, and perform analog-to-digital conversion on the difference signal between the read data signals. In this case, for example, an edge detection signal can be obtained. Even if the readout operation is performed in this way, as described above, the noise caused by the analog-to-digital conversion can be reduced by 1 / √2, and the readout operation can be performed at low power. However, in this case, it is difficult to eliminate the reset noise generated by the floating diffusion node of the pixel 10. Therefore, obtaining the difference between the signals transmitted to the same floating diffusion node can suppress the reset noise more strongly.
[0059] Figure 5 It is shown Figure 2 FIG. 4 is a diagram of a variation of the pixel 10 shown in FIG. Figure 6 It is shown that Figure 5 The following is a timing chart of an operation example of the photoelectric conversion device 1000 of the pixel 10 shown in FIG. Figures 1 to 4 The descriptions of arrangements and operations similar to those in the above description will be omitted as appropriate.
[0060] like Figure 5 As shown, except Figure 2 In addition to the arrangement shown, the pixel 10 further includes a photoelectric conversion element 401 and a transfer transistor 411. Figure 5 In the arrangement shown, the pixel 10 is a so-called floating diffusion node sharing pixel, in which the photoelectric conversion element 400 and the photoelectric conversion element 401 are connected to the node 420. In this arrangement, the two photoelectric conversion elements 400 and 401 share the node 420 used as the floating diffusion node. It can also be said that Figure 5 The illustrated pixel 10 is, for example, a pixel corresponding to two pixels in the vertical direction each including one photoelectric conversion element.
[0061] Here, the photoelectric conversion element 400 and the photoelectric conversion element 401 arranged in the pixel 10 share one node 420 and form a photoelectric conversion element group, and as described later, the difference between the data signals is obtained for the photoelectric conversion element group. A plurality of pixels 10 are arranged in the photoelectric conversion unit 5. Therefore, it can also be said that a plurality of photoelectric conversion element groups formed by the photoelectric conversion elements 400 and 401, and a plurality of floating diffusion nodes respectively corresponding to the plurality of photoelectric conversion element groups are arranged in the photoelectric conversion unit 5.
[0062] For example, the photoelectric conversion element 401 may be a photodiode like the photoelectric conversion element 400. The transfer transistor 411 may have an arrangement similar to that of the transfer transistor 410. One of the two main electrodes of the photoelectric conversion element 401 is connected to the ground potential 450. The other of the two main electrodes of the photoelectric conversion element 401 is connected to the node 420 via the transfer transistor 411. A control signal TXA is supplied to the gate electrode of the transfer transistor 410 in place of the above-mentioned control signal TX, so as to be distinguished from the control signal TXB supplied to the gate electrode of the transfer transistor 411. When the control signals TXA and TXB are supplied to the gate electrodes of the transfer transistors 410 and 411 and the transfer transistors 410 and 411 are turned on according to the control signals TXA and TXB, the signal charges accumulated in the photoelectric conversion elements 400 and 401 are transferred to the node 420.
[0063] Next, refer to Figure 6 The timing diagram shown will mainly describe the Figure 5 The operation example of the photoelectric conversion device 1000 of the pixel 10 shown is similar to the above Figure 4 The operation example shown is different from Figure 4 , the operation of one photoelectric conversion element group of interest (pixel 10 and photoelectric conversion elements 400 and 401) will be described, but similar operations can also be performed in each photoelectric conversion element group (pixel 10 and photoelectric conversion elements 400 and 401) arranged in the photoelectric conversion unit 5. In this case, the operation can be performed simultaneously in the photoelectric conversion element groups (pixels 10 and photoelectric conversion elements 400 and 401) arranged in the same row as the photoelectric conversion element group of interest (pixel 10 and photoelectric conversion elements 400 and 401). Figure 6 Furthermore, similar operations may be sequentially performed on each row in the photoelectric conversion element group (pixel 10 and photoelectric conversion elements 400 and 401) arranged in the same column as the photoelectric conversion element group of interest (pixel 10 and photoelectric conversion elements 400 and 401).
[0064] In the period from time t5 to time t6, Figure 5 The control signal TXA shown is set to a high level, and the transfer transistor 410 is turned on, so that the charge is transferred from the photoelectric conversion element 400 to the node 420 serving as the floating diffusion node. In the period from time t5 to time t8, as described above, Figure 3 The capacitive element 121 of the sample-and-hold circuit 211 and the capacitive element 123 of the sample-and-hold circuit 210 shown sample and hold a first data signal based on the charge of the photoelectric conversion element 400 .
[0065] In the period from time t9 to time t10, Figure 5The control signal TXB shown is set to a high level, and the transfer transistor 411 is turned on, so that the charge is transferred from the photoelectric conversion element 401 to the node 420 serving as the floating diffusion node. In the period from time t9 to time t12, Figure 3 The capacitive element 122 of the sample-and-hold circuit 211 shown samples and holds the second data signal based on the charges of the photoelectric conversion element 400 and the photoelectric conversion element 401 .
[0066] In this way, in the sampling and holding unit 50, after the first transfer operation of transferring the charge from the photoelectric conversion element 400 to the node 420 serving as the floating diffusion node and before the second transfer operation of transferring the charge from the photoelectric conversion element 401 to the node 420 without resetting the node 420 after the first transfer operation, the first data signal based on the charge transferred from the photoelectric conversion element 400 to the floating diffusion node is sampled in the capacitance element 123 of the sampling and holding circuit 210 and the capacitance element 121 of the sampling and holding circuit 211. In addition, in the sampling and holding unit 50, after the second transfer operation, the second data signal based on the charge transferred from the photoelectric conversion element 400 and the photoelectric conversion element 401 to the floating diffusion node is sampled in the capacitance element 122 of the sampling and holding circuit 211. In addition, in the sampling and holding unit 50, as in the above description, when the node 420 serving as the floating diffusion node is reset, the reset signal corresponding to the voltage of the reset node 420 is sampled and held in the capacitance element 120 of the sampling and holding circuit 210.
[0067] After time t13, as described above, the conversion circuit 60 performs analog-to-digital conversion on the difference between the potential Vs1 of the first data signal and the potential Vn of the reset signal. In addition, the conversion circuit 60 performs analog-to-digital conversion on the difference between the potential Vn2 of the second data signal and the potential Vs1 of the first data signal. In this way, a digital signal based on the charge generated by each of the photoelectric conversion elements 400 and 401 according to the incident light can be obtained. Through the above operation, signals can be read out from the photoelectric conversion elements 400 and 401 of two rows during a unit readout period for reading out signals from one pixel 10, and the signal readout speed can be improved. In addition, Figure 4 As in the illustrated operation, since the analog-to-digital conversion of the difference signal (difference value) is performed after the differential processing of the data signal, the signal can be read out with low noise and low power.
[0068] exist Figure 5 The layout shown and Figure 6In the operation shown, a microlens corresponding to the photoelectric conversion element 400 and a microlens corresponding to the photoelectric conversion element 401 can be arranged separately. In this way, the speed of reading out the data signal (also called the image signal) can be improved as described above. However, the present invention is not limited to this, and the photoelectric conversion element 400 and the photoelectric conversion element 401 can share a microlens. For example, the photoelectric conversion elements 400 and 401 can be a pair of photodiodes formed under the same microlens, and the pixel 10 can form a phase difference detection pixel. In this case, through the above-mentioned readout operation, the autofocus (AF) signal can be read out at high speed, low noise, and low power.
[0069] For example, the sensitivity of the photoelectric conversion element 400 and the photoelectric conversion element 401 to incident light may be different from each other. For example, in order to change the sensitivity, the photoelectric conversion elements 400 and 401 may be photodiodes having different light incident areas. In this way, the above-mentioned HDR imaging can be realized.
[0070] The form of the photoelectric conversion device 1000 is not limited to the above-mentioned form. For example, in the photoelectric conversion unit 5 that receives incident light, a plurality of vertical signal lines 30 may be arranged for one pixel column. In this case, a plurality of selection transistors 440 may be arranged in the pixel 10 so as to select the vertical signal line 30 output signal from the plurality of vertical signal lines 30 arranged corresponding to one pixel column. Alternatively, for example, a part of the pixels 10 arranged in one pixel column may be connected to one vertical signal line 30, and another part of the pixels 10 arranged in the one pixel column may be connected to another vertical signal line 30. Alternatively, the photoelectric conversion device 1000 may be formed without the sampling and holding circuits 210 and 211. In this case, a signal corresponding to the difference between the signals respectively output to the plurality of vertical signal lines 30 may be input to the conversion circuit 60. The plurality of vertical signal lines 30 for obtaining the difference may be the plurality of vertical signal lines 30 arranged corresponding to the pixels 10 in one column. In this case, a signal corresponding to the signal difference between the pixels 10 in a plurality of rows may be obtained. Alternatively, the plurality of vertical signal lines 30 for obtaining the difference may be a vertical signal line 30 arranged corresponding to the pixels 10 in the first column and a vertical signal line 30 arranged corresponding to the pixels 10 in another second column. In this case, a signal corresponding to the signal difference between the pixels 10 in the plurality of columns can be obtained. That is, two signals, namely, signals corresponding to the signal charges generated by the photoelectric conversion unit 5 based on the incident light, respectively, can be input to the resistor element 240 serving as a differential circuit arranged between the vertical signal lines 30 different from each other.
[0071] As described above, in the photoelectric conversion device 1000, the pixel substrate 1 and the circuit substrate 2 may be stacked. Figure 1In the arrangement shown, the current source 40, the sampling and holding unit 50, the conversion circuit 60, the data processing circuit 90 and the output unit 100 are shown as being arranged on one circuit substrate 2. However, the present invention is not limited thereto, and the components forming the circuit substrate 2 may be distributed and arranged on a plurality of substrates. For example, the circuit substrate 2 may be formed by stacking a substrate including the current source 40 and the sampling and holding unit 50 and a substrate including the conversion circuit 60, the data processing circuit 90 and the output unit 100. The circuit substrate 2 may be a stacked substrate including three or more layers in which the components are appropriately distributed and arranged. On the other hand, for example, the pixel substrate 1 and the circuit substrate 2 may be arranged on one substrate. The pixel substrate 1 and the circuit substrate 2 may be appropriately arranged according to the specifications required for the photoelectric conversion device 1000, etc. The components of the photoelectric conversion device 1000 may be distributed and arranged on three or more stacked substrates.
[0072] Application examples of the photoelectric conversion device 1000 according to the above-described embodiment will be described below. Figure 7 1 is a schematic diagram of an electronic device EQP including a photoelectric conversion device 1000 . Figure 7 A camera is shown as an example of the electronic instrument EQP. The concept of the camera here includes not only a device whose main purpose is to shoot, but also a device that auxiliary has a shooting function (for example, a personal computer or a mobile terminal such as a smartphone).
[0073] The photoelectric conversion device 1000 may be a semiconductor chip having a stacked structure, and the stacked structure is provided with a photoelectric conversion unit 5. Figure 7 As shown, the photoelectric conversion device 1000 is included in a semiconductor package PKG. The semiconductor package PKG may include a base to which the photoelectric conversion device 1000 is fixed, a cover (such as glass) facing the photoelectric conversion device 1000, and a conductive connection member (such as a bonding wire or a bump) for connecting a terminal arranged in the base to a terminal arranged in the photoelectric conversion device 1000. The instrument EQP may also include at least one of an optical system OPT, a control device CTRL, a processing device PRCS, a display device DSPL, and a storage device MMRY.
[0074] The optical system OPT is a system for forming an image on the photoelectric conversion device 1000, and may be, for example, a lens, a shutter, and a mirror. The control device CTRL is a device for controlling the operation of the photoelectric conversion device 1000, and may be, for example, a semiconductor device such as an ASIC. The processing device PRCS processes the signal output by the photoelectric conversion device 1000, and may be, for example, a semiconductor device such as a CPU, an ASIC, etc. The display device DSPL may be an EL display device or a liquid crystal display device that displays the image data obtained by the photoelectric conversion device 1000. The storage device MMRY is a magnetic device or a semiconductor device for storing the image data obtained by the photoelectric conversion device 1000. The storage device MMRY may be a volatile memory such as an SRAM, a DRAM, etc., or a non-volatile memory such as a flash memory or a hard disk drive. The mechanical device MCHN includes a moving or propulsion unit such as a motor or an engine. The mechanical device MCHN in the camera may drive components of the optical system OPT to perform zooming, focusing, and shutter operations. In the instrument EQP, the image data output from the photoelectric conversion device 1000 is displayed on the display device DSPL, or transmitted to an external device through a communication device (not shown) included in the instrument EQP. Therefore, the instrument EQP may further include a storage device MMRY and a processing device PRCS.
[0075] The camera including the photoelectric conversion device 1000 can also be used as a surveillance camera or an onboard camera installed in transportation equipment such as a car, a railway vehicle, a ship, an airplane, or an industrial robot. In addition, the camera including the photoelectric conversion device 1000 is not limited to transportation equipment, but is also applicable to instruments that widely use object recognition, such as an intelligent transportation system (ITS).
[0076] While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments.The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.
Claims
1. A photoelectric conversion device, comprising: a photoelectric conversion unit configured to receive incident light; a differential circuit configured to receive a first signal and a second signal, which are signals respectively corresponding to signal charges generated by the photoelectric conversion unit based on incident light, and output a third signal indicating a difference between the first signal and the second signal; as well as The oversampling conversion circuit is configured to perform analog-to-digital conversion on the third signal.
2. The photoelectric conversion device according to claim 1, wherein A plurality of photoelectric conversion elements are arranged in a photoelectric conversion unit, The first signal is a signal based on charges generated in a part of the plurality of photoelectric conversion elements according to incident light, and The second signal is a signal based on charges generated in another part of the plurality of photoelectric conversion elements according to incident light.
3. The photoelectric conversion device according to claim 2, further comprising: a sample-and-hold unit configured to receive the first signal and the second signal and hold the first signal and the second signal, in, The output node of the sample and hold unit is electrically connected to the differential circuit, A plurality of floating diffusion nodes are further arranged in the photoelectric conversion unit to respectively correspond to the plurality of photoelectric conversion elements, and In the sample and hold unit, after a first transfer operation of transferring charges from a first photoelectric conversion element of interest among the plurality of photoelectric conversion elements to a first floating diffusion node corresponding to the first photoelectric conversion element among the plurality of floating diffusion nodes, and before a second transfer operation of transferring charges from the first photoelectric conversion element to the first floating diffusion node without resetting the first floating diffusion node after the first transfer operation, sampling a first signal based on the charges transferred to the first floating diffusion node, and After the second transfer operation, a second signal based on the charges transferred to the first floating diffusion node is sampled.
4. The photoelectric conversion device according to claim 1, wherein A plurality of photoelectric conversion elements are arranged in a photoelectric conversion unit, The plurality of photoelectric conversion elements form a plurality of photoelectric conversion element groups, each of which includes at least two photoelectric conversion elements. The first signal is a signal based on charges generated in a part of the plurality of photoelectric conversion element groups according to incident light, and The second signal is a signal based on charges generated in another part of the plurality of photoelectric conversion element groups according to incident light.
5. The photoelectric conversion device according to claim 4, wherein: Each of the plurality of photoelectric conversion element groups includes a first photoelectric conversion element and a second photoelectric conversion element. The first signal is a signal based on charges generated in the first photoelectric conversion element according to incident light, and The second signal is a signal based on the charge generated in the first photoelectric conversion element according to the incident light and the charge generated in the second photoelectric conversion element according to the incident light.
6. The photoelectric conversion device according to claim 5, further comprising: a sample-and-hold unit configured to receive the first signal and the second signal and hold the first signal and the second signal, in, The output node of the sample and hold unit is electrically connected to the differential circuit, A plurality of floating diffusion nodes are further arranged in the photoelectric conversion unit to correspond to the plurality of photoelectric conversion element groups, respectively, and In the sample and hold unit, After a first transfer operation of transferring charges from the first photoelectric conversion element of a photoelectric conversion element group of interest among the plurality of photoelectric conversion element groups to a first floating diffusion node corresponding to the photoelectric conversion element group of interest among the plurality of floating diffusion nodes, and before a second transfer operation of transferring charges from the second photoelectric conversion element to the first floating diffusion node without resetting the first floating diffusion node after the first transfer operation, sampling a first signal based on the charges transferred to the first floating diffusion node, and After the second transfer operation, a second signal based on the charges transferred to the first floating diffusion node is sampled.
7. The photoelectric conversion device according to claim 6, wherein: The first photoelectric conversion element and the second photoelectric conversion element share a microlens.
8. The photoelectric conversion device according to claim 6, wherein: The first photoelectric conversion element and the second photoelectric conversion element have different sensitivities to incident light from each other.
9. The photoelectric conversion device according to claim 3, wherein: When the first floating diffusion node is reset, the sample-and-hold unit samples the fourth signal, and The oversampling conversion circuit further performs analog-to-digital conversion on a fifth signal, where the fifth signal indicates a difference between the first signal and the fourth signal and is output by the differential circuit.
10. The photoelectric conversion device according to claim 9, wherein The sample and hold unit includes: a first sample-and-hold circuit including a first capacitive element, a second capacitive element, and an output amplifier shared by the first capacitive element and the second capacitive element; and a second sample-and-hold circuit including a third capacitive element, a fourth capacitive element, and an output amplifier shared by the third capacitive element and the fourth capacitive element, The first signal is held by the first capacitive element and the third capacitive element, The second signal is held by the fourth capacitive element, The fourth signal is held by the second capacitive element, and The differential circuit generates a third signal based on the first signal held by the first capacitance element and the second signal held by the fourth capacitance element.
11. The photoelectric conversion device according to claim 10, wherein The differential circuit generates a fifth signal based on the first signal held by the third capacitance element and the fourth signal held by the second capacitance element.
12. The photoelectric conversion device according to claim 1, wherein The differential circuit generates a current corresponding to a signal voltage difference between the first signal and the second signal as a third signal.
13. The photoelectric conversion device according to claim 1, wherein The oversampling conversion circuit includes a ΔΣ analog-to-digital conversion circuit.
14. An electronic device comprising: The photoelectric conversion device according to any one of claims 1 to 13; as well as A control device is configured to control the operation of the photoelectric conversion apparatus.
15. A substrate stacked on a substrate provided with a photoelectric conversion unit, the photoelectric conversion unit being configured to receive incident light, the substrate comprising: a differential circuit configured to receive a first signal and a second signal, which are signals respectively corresponding to signal charges generated by the photoelectric conversion unit based on incident light, and output a third signal indicating a difference between the first signal and the second signal; as well as The oversampling conversion circuit is configured to perform analog-to-digital conversion on the third signal.
