Photoelectric conversion device, photoelectric conversion system, mobile object, equipment
The photoelectric conversion device addresses the issue of exposure period control by using a control signal separate from synchronization signals to manage the start and end of exposure periods, ensuring consistent image brightness.
Patent Information
- Application Number
- JP2021171693
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-10-20
- Publication Date
- 2025-08-19
- Estimated Expiration
- 2041-10-20
AI Technical Summary
Existing photoelectric conversion devices lack control over the exposure period, particularly when the length of the exposure period is changed, leading to potential brightness differences within images.
A photoelectric conversion device with a pixel section, scanning section, and control section that allows for separate control of the start and end processes of the exposure period for each row, using a control signal distinct from synchronization signals to manage the timing of the readout process.
Enables flexible adjustment of the exposure period, ensuring consistent image brightness across the entire image capture, thereby improving image quality.
Smart Images

Figure 0007725332000001 
Figure 0007725332000002 
Figure 0007725332000003
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to a photoelectric conversion device, a photoelectric conversion system, a mobile object, and equipment. [Background technology]
[0002] A photoelectric conversion device including a pixel array in which multiple pixels, each including an avalanche photodiode (APD), are arranged is known. Avalanche multiplication occurs in the PN junction region of the APD due to the charge generated by incident light.
[0003] Patent Document 1 discloses a device including an APD, a quench circuit connected to the APD, a quench circuit having a gate to which a pulse signal is input, and a pulse generating circuit that generates the pulse signal. The pulse generating circuit controls the on / off of the quench circuit. The exposure period of the APD is controlled by this pulse signal. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2020-123847 A Summary of the Invention [Problem to be solved by the invention]
[0005] In the technique described in Patent Document 1, no consideration is given to control of the exposure period.
[0006] For example, no consideration has been given to a suitable configuration of a photoelectric conversion device when the length of the exposure period is changed. [Means for solving the problem]
[0007] One aspect of the present disclosure is a photoelectric conversion device comprising: a pixel section in which a plurality of pixels are arranged across a plurality of rows, each pixel having a quench element having a gate to which a pulse signal that defines the start and end of an exposure period is input, and an avalanche photodiode connected to the quench element; a scanning section that scans the pixel section by performing a readout process to read out signals from the pixels, a start process for the exposure period, and an end process for the exposure period row-sequentially for the plurality of rows, with one or more rows as a unit; and a control section that outputs a synchronization signal to the scanning section to control the timing of the readout process, wherein the timing of at least one of the start process and the end process is controlled by a control signal separate from the synchronization signal. [Effects of the Invention]
[0008] The present disclosure makes it possible to provide a photoelectric conversion device that can suitably change the length of the exposure period. [Brief explanation of the drawings]
[0009] [Figure 1] Photoelectric conversion device configuration diagram [Figure 2] Pixel configuration diagram [Figure 3] Control unit configuration diagram [Figure 4] Vertical scanning control unit configuration diagram [Figure 5] Vertical scanning unit configuration diagram [Figure 6] Pixel drive timing diagram [Figure 7] Pixel configuration diagram [Figure 8] Pixel configuration diagram [Figure 9] Vertical scanning control unit configuration diagram [Figure 10] Vertical scanning unit configuration diagram [Figure 11] Pixel drive timing diagram [Figure 12] Diagram showing the configuration of a photoelectric conversion system [Figure 13] Diagram showing the structure and operation of a moving object [Figure 14] Equipment configuration diagram DETAILED DESCRIPTION OF THE INVENTION
[0010] Hereinafter, each embodiment will be described with reference to the drawings.
[0011] In the following embodiments, an image pickup device will be mainly described as an example of a photoelectric conversion device. However, the embodiments are not limited to image pickup devices and can be applied to other examples of photoelectric conversion devices. For example, a distance measurement device (a device that measures distance using focus detection or TOF (Time Of Flight)) or a photometry device (a device that measures the amount of incident light) can be used.
[0012] The conductivity types of the transistors described in the following embodiments are merely examples and are not limited to those described in the examples. The conductivity types described in the embodiments can be changed as appropriate, and the potentials of the gate, source, and drain of the transistors can be changed as appropriate.
[0013] For example, if a transistor is operated as a switch, the low and high levels of the potential supplied to the gate can be reversed relative to the description in the embodiments in accordance with a change in the conductivity type. Furthermore, the conductivity types of the semiconductor regions described in the following examples are merely examples and are not limited to the conductivity types described in the embodiments. The conductivity types described in the embodiments can be changed as appropriate, and the potential of the semiconductor region can be changed accordingly. For example, in the following embodiments, an example is described in which the quench element 12 connected to the avalanche diode is a PMOS transistor, but it may also be changed to an NMOS transistor. In this case, the high and low levels of the signal supplied to the gate can be changed.
[0014] First Embodiment [Overall Description of Photoelectric Conversion Device 100] 1 is a block diagram showing a schematic configuration of a photoelectric conversion device according to this embodiment. As shown in FIG. 1, the photoelectric conversion device 100 according to this embodiment includes a pixel section 10, a control section 20, a vertical scanning section 30 (scanning section), a signal processing section 40, a horizontal scanning section 50 (second scanning section), and an output section 60.
[0015] The pixel section 10 has a plurality of pixels P arranged across a plurality of rows and a plurality of columns. In Fig. 1, the pixels P arranged in N rows from the first row to the Nth row and M columns from the first column to the Mth column are shown with reference symbols indicating the row number and the column number. For example, the pixel P arranged in the first row and first column is given the reference symbol P(1,1).
[0016] It should be noted that the pixels P do not necessarily have to be arranged in multiple columns in the pixel section 10. For example, the pixels P may be arranged in one column and multiple rows.
[0017] A control line group 150 is arranged in each row of the pixel array of the pixel unit 10, extending in a first direction (the horizontal direction in FIG. 1). The control line group 150 is connected to each pixel P aligned in the first direction and is commonly connected to the pixels P in multiple columns arranged in one row. The control line group 150 includes multiple control lines for controlling the pixels P in one row. Each of these multiple control lines transmits a signal pCLK, a signal pRES, and a signal pVSEL (described later) from the vertical scanning unit 30 to the pixels P in the corresponding row. The vertical scanning unit 30 selects the pixels P in each row of the pixel unit 10 one row at a time or in units of two or more rows in a row-sequential manner. In this way, row scanning (vertical scanning) of the pixel unit 10 is performed by the vertical scanning unit 30. Note that the term "unit" here refers to one or two or more pixel rows whose periods of selection by the vertical scanning unit 30 overlap as one group.
[0018] The first direction in which the control line group 150 extends may be referred to as the row direction or the horizontal direction. Note that in Fig. 1, the control line group 150 is shown with a reference numeral indicating the row number. For example, the control line group in the first row is given the reference numeral 150[1].
[0019] The control line group 150 of each row is connected to the vertical scanning section 30. The vertical scanning section 30 supplies control signals for driving the pixels P to the pixels P via the control lines.
[0020] An output line 152 is arranged in each column of the pixel array of the pixel unit 10, extending in a second direction (the vertical direction in FIG. 1) intersecting the first direction. The output line 152 is connected to each of the pixels P aligned in the second direction, and serves as a signal line common to these pixels P.
[0021] The second direction in which the output lines 152 extend may be referred to as the column direction or the vertical direction. Note that in FIG. 1, the output lines 152 are indicated with a symbol indicating the column number. For example, the output line for the first column is designated by the symbol pOUT[1]. Each output line 152 outputs a digital pixel signal from a pixel P in a row selected by the vertical scanning unit 30. Typically, the pixel signal is a multi-bit digital signal. The output line 152 may be configured as a bus including multiple signal lines transmitting corresponding 1-bit signals among the multi-bit digital signals. This allows for parallel transmission of each bit of the digital signal. Alternatively, multiple buses may be provided for each column of pixels P. Some of the multiple buses are connected to pixels P in some rows of multiple rows, and other buses are connected to pixels P in other rows. This allows for parallel readout of digital signals from pixels P in multiple rows. It should be noted that the present disclosure is not limited to this configuration, and it is also possible to provide only one output line 152 corresponding to one column of pixels P, and transmit a multi-bit digital signal serially.
[0022] The output line 152 is connected to the signal processing unit 40. The signal processing unit 40 is provided corresponding to each column of the pixel unit 10, and is connected to the output line 152 of the corresponding column. The signal processing unit 40 includes a holding unit that holds pixel signals output from the pixels P via the output line 152 of the corresponding column.
[0023] The horizontal scanning unit 50 is a circuit unit that supplies the signal processing unit 40 with a control signal for reading out a signal from the signal processing unit 40. The horizontal scanning unit 50 supplies a control signal to the signal processing unit 40 of each column via a control line 154. Upon receiving the control signal from the horizontal scanning unit 50, the signal processing unit 40 outputs the signal held in the holding unit to the output unit 60. The horizontal scanning unit 50 selects one or more columns of the signal processing units 40 at a time to perform column scanning (horizontal scanning). A horizontal synchronization signal HD is input to the horizontal scanning unit 50 from the control unit 20. When the level of the horizontal synchronization signal HD changes, the horizontal scanning unit 50 starts horizontal scanning (second scanning) of the signal processing units 40 of each column. Typically, when the horizontal synchronization signal HD transitions from low level to high level, the horizontal scanning unit 50 starts horizontal scanning of the signal processing units 40 of each column. The horizontal synchronization signal HD is a signal that controls the cycle at which horizontal scanning is performed.
[0024] 1, the control lines 154 are indicated with a reference numeral indicating the column number, for example, the control line for the first column is given the reference numeral 154[1].
[0025] The output unit 60 is a circuit unit for outputting the signal output from the signal processing unit 40 to the outside of the photoelectric conversion device 100. Note that the output unit 60 may perform various processes, such as noise reduction and correction, on the signal before outputting it to the outside of the photoelectric conversion device 100.
[0026] The control unit 20 is a circuit unit for supplying control signals that control the operations and timing of the vertical scanning unit 30, the signal processing unit 40, the horizontal scanning unit 50, and the output unit 60.
[0027] The CPU 70 is a circuit unit for controlling the photoelectric conversion device via the control unit 20 by executing a program.
[0028] At least some of the control signals that control the operations and timings of the control unit 20, vertical scanning unit 30, signal processing unit 40, horizontal scanning unit 50, output unit 60, and CPU 70 may be supplied from outside the photoelectric conversion device 100.
[0029] [Pixel P(m,n)] FIG. 2 is a diagram showing the configuration of a pixel P(m,n) of the photoelectric conversion device of this embodiment.
[0030] The pixel P(m,n) has an APD 11, a quench circuit unit 19, a waveform shaping unit 13, a counter 14, and a pixel output circuit 15. The quench circuit unit 19 is configured by a quench element 12 in the example of FIG.
[0031] The APD 11 generates charge pairs through photoelectric conversion in response to incident light (in response to incident photons). A voltage VL (first voltage) is supplied to the anode of the APD 11. A voltage VH (second voltage) higher than the voltage VL supplied to the anode is supplied to the cathode of the APD 11. A reverse bias voltage is supplied to the anode and cathode so that the APD 11 performs avalanche multiplication. With this voltage supplied, the charge (seed charge) generated by the incident light undergoes avalanche multiplication, generating an avalanche current.
[0032] When a reverse bias voltage is supplied, there are two modes: Geiger mode, in which the anode and cathode are operated at a potential difference greater than the breakdown voltage, and linear mode, in which the anode and cathode are operated at a potential difference close to or less than the breakdown voltage.
[0033] An APD operated in Geiger mode is called a SPAD (single photon avalanche diode). For example, the voltage VL (first voltage) is −30 V, and the voltage VH (second voltage) is 3 V. The APD 11 may be operated in either linear mode or Geiger mode.
[0034] The quench element 12 is connected to a power supply line that supplies a voltage VH and the APD 11. The quench element 12 functions as a load circuit (quench circuit) when signals are multiplied by avalanche multiplication.
[0035] The quench element 12 can be configured with a transistor. For example, the quench element 12 can be configured with a MOS transistor, and Fig. 2 shows the case where the quench element 12 is a PMOS transistor.
[0036] The quench element 12 receives a signal pCLK at its gate, which is a control node. When the signal pCLK is inactive, the quench element 12 is in a non-conductive state (off state). On the other hand, when the signal pCLK is active, the quench element 12 is in a conductive state (on state). When the quench element 12 is in a non-conductive state, it suppresses the voltage supplied to the APD 11 and suppresses avalanche multiplication (quench operation). When the quench element 12 is in a conductive state, it returns the voltage supplied to the APD 11 to voltage VH by flowing a current equivalent to the voltage drop caused by the quench operation (recharge operation). Note that the off state of the quench element 12 does not necessarily mean that the electrical path between the power supply line supplying voltage VH and the APD 11 is completely non-conductive (cut off); it is sufficient that the resistance be controlled to a value required for quench operation. Therefore, the OFF state of the quench element 12 should be a state in which the resistance value of the electrical path between the power supply line and the APD 11 is larger than that in the ON state of the quench element 12.
[0037] A signal pCLK[n] is supplied to the gate of the quench element 12 via a control line (not shown in FIG. 1) to switch between a conductive state and a non-conductive state of the quench element 12. This signal pCLK is a pulse signal input to the gate of the quench element 12 as a control signal that defines the start and end of the exposure period of the pixel P.
[0038] The waveform shaping unit 13 shapes the potential change at the cathode of the APD 11 obtained upon photon detection and outputs a pulse signal. For example, an inverter circuit is used as the waveform shaping unit 13. While FIG. 2 shows an example in which one inverter is used as the waveform shaping unit 13, a circuit in which multiple inverters are connected in series may also be used. Alternatively, other circuits that have a waveform shaping effect may also be used as the waveform shaping unit 13.
[0039] The counter 14 counts the number of pulse signals output from the waveform shaping unit 13 and holds the count value. In addition, a signal pRES[n] is supplied from the vertical scanning unit 30 via a control line (not shown in FIG. 1). When this signal pRES[n] is active, the count value held in the counter 14 is reset to an initial value. This initial value is typically a value where all bits are 0, but it may also be reset to another initial value.
[0040] A signal pVSEL[n] is supplied to the pixel output circuit 15 from the vertical scanning unit 30 via a control line. This signal vSEL[n] switches between electrical connection and disconnection between the counter 14 and the signal line pOUT[m]. The pixel output circuit 15 includes, for example, a buffer circuit for outputting a signal.
[0041] Furthermore, a switch such as a transistor may be further provided between the APD 11 and the quenching element 12 to switch between electrical connection and disconnection. Similarly, a switch such as a transistor that switches between supplying and not supplying the voltage VH supplied to the quenching element 12 may be further provided in the configuration of FIG. 2. This switch may be provided for each pixel or for each pixel row. Alternatively, one switch may be shared by all pixels. Similarly, a switch such as a transistor that switches between supplying and not supplying the voltage VL supplied to the APD 11 may be further provided in the configuration of FIG. 2. This switch may be provided for each pixel or for each pixel row. Alternatively, one switch may be shared by all pixels.
[0042] In this embodiment, a configuration using the counter 14 has been described. However, instead of the counter 14, the photoelectric conversion device 100 may be configured to acquire pulse detection timing using a time-to-digital converter (hereinafter referred to as TDC) and a memory. In this case, the generation timing of the pulse signal output from the waveform shaping unit 13 is converted into a digital signal by the TDC. To measure the timing of the pulse signal, the TDC is supplied with a signal pREF[n] from the vertical scanning unit 30 in FIG. 1 via a control line (not shown in FIG. 1). The TDC acquires, as a digital signal, a signal obtained by converting the input timing of the signal output from each pixel via the waveform shaping unit 13 into a relative time based on the signal pREF[n].
[0043] [Control unit 20] 3 is a configuration diagram of the control unit 20. A control signal is input to the control unit 20 from a CPU 70 provided outside the control unit 20. The control unit 20 includes a synchronization signal generation unit 21, a vertical scanning control unit 22, a signal processing control unit 23, and a horizontal scanning control unit 24.
[0044] The synchronization signal generation unit 21 generates a vertical synchronization signal VD, a horizontal synchronization signal HD, and a clock MCLK (reference clock signal) under the control of the CPU 70. The vertical synchronization signal VD is a signal that controls the period of one frame. Typically, the start of vertical scanning by the vertical scanning unit 30 is controlled based on the vertical synchronization signal VD. The horizontal synchronization signal HD is a signal that switches the selection of pixel rows in vertical scanning and horizontal scanning. The horizontal synchronization signal HD is a signal that controls a readout process that reads out signals from pixels P in each row. The vertical synchronization signal VD is also a signal that controls a readout process that reads out signals from the entire pixel unit.
[0045] The vertical scanning control unit 22 generates a signal for controlling the drive timing of the vertical scanning unit 30 and outputs the signal to the vertical scanning unit 30 .
[0046] The signal processing control unit 23 generates a signal for controlling the drive timing of the signal processing unit 40 and outputs it to the signal processing unit 40 .
[0047] The horizontal scanning control unit 24 generates a signal for controlling the drive timing of the horizontal scanning unit 50 and outputs it to the horizontal scanning unit 50 .
[0048] [Vertical scanning control unit 22] 4 is a configuration diagram of the vertical scanning control unit 22. The vertical scanning control unit 22 includes a pulse signal generation unit 221, a horizontal synchronization signal count unit 222, a pulse count unit 223, a read signal generation unit 224, a reset signal generation unit 225, and a start trigger generation unit 226. The vertical scanning control unit 22 further includes a selection generation unit 228.
[0049] The pulse signal generating unit 221 has a frequency dividing circuit (not shown) that divides the frequency of the clock MCLK to generate signals P_CLK1 and P_CLK2. By using the clock MCLK as the original signal, the periods of the signals P_CLK1 and P_CLK2 can be controlled in units of one cycle of the clock MCLK. Each of the signals P_CLK1 and P_CLK2 is input to the vertical scanning unit 30.
[0050] The horizontal synchronizing signal counting unit 222 receives the vertical synchronizing signal VD and the horizontal synchronizing signal HD, counts the number of horizontal synchronizing signals HD in one cycle of the vertical synchronizing signal VD, and outputs a count value cnt_HD.
[0051] The pulse counting unit 223 receives the vertical synchronization signal VD and the signal P_CLK, counts the signal P_CLK for one period of the vertical synchronization signal VD, and outputs a count value cnt_P_CLK.
[0052] The read signal generating unit 224 receives the count value cnt_HD and generates a signal P_VSEL according to the count value cnt_HD.
[0053] The reset signal generating unit 225 receives the count value cnt_HD and generates a signal P_RES according to the count value cnt_HD.
[0054] The start trigger generation unit 226 receives the count value cnt_P_CLK and generates a signal P_EXP_STR according to the count value cnt_P_CLK. The signal P_EXP_STR is a control signal that controls the exposure start timing of the pixel P.
[0055] The selection generation unit 228 receives the signal P_EXP_STR and generates signals P_SH1 and P_SH2 indicating the shutter number. Note that the number of input signals P_EXP_STR may be two or more, and the number of output signals P_SH may be three or more.
[0056] Furthermore, the pulse signal generating unit 221 outputs the signal P_CLK1 and the signal P_CLK2, each having a different frequency. Note that the signal P_CLK output by the pulse signal generating unit 221 may be three or more clock signals having different cycles.
[0057] [Vertical scanning unit 30] 5 is a configuration diagram of the vertical scanning unit 30. The vertical scanning unit 30 includes a first decoder unit 31, a second decoder unit 32, a third decoder unit 33, and N row driver units 35 arranged for each row of pixels in the pixel unit 10. Each row driver unit 35 is configured to drive one row of pixels in the pixel unit 10, but may also be configured to drive multiple rows.
[0058] The first decoder section 31 decodes the signal P_VSEL generated by the vertical scanning control section 22 to generate read row selection signals vp_vsel(1) to (N), and outputs them to the row driving sections .
[0059] Similarly, the second decoder section 32 decodes the signal P_RES generated by the vertical scanning control section 22 to generate reset row selection signals vp_res(1) to (N), and outputs them to the row driving sections .
[0060] Similarly, the third decoder section 33 decodes the signal P_EXP_STR generated by the vertical scanning control section 22 to generate exposure start row selection signals vp_exp_str(1) to (N), and outputs them to the row driving sections .
[0061] The row driver 35 includes a readout control unit 351, an exposure start control unit 352, an exposure end control unit 353, and a pixel drive signal generation unit 354. The row driver 35 further includes a selection holding unit 356 and a pulse signal selection unit 357.
[0062] The selection holding unit 356 receives the signals P_SH1, P_SH2, and vp_exp_str(1) and generates a signal p_sh[1] indicating the shutter number of the target row.
[0063] The pulse signal selection unit 357 (selection unit) inputs the signals P_CLK1, P_CLK2, and p_sh[1], selects the signal P_CLK to be used in the target row from either the signal P_CLK1 or the signal P_CLK2, and outputs it as the signal p_clk[1]. In other words, the pulse signal selection unit 357 is a selection unit that selects the clock signal to be output from among multiple input clock signals with different cycles.
[0064] In the following description, the configuration of the row driver 35 for the first row will be mainly described, but the row driver 35 for the other rows will also have the same configuration.
[0065] The readout row selection signal vp_vsel(1) output from the first decoder unit 31 and the reset row selection signal vp_res(1) output from the second decoder unit 32 are input to the readout control unit 351. The readout control unit 351 is controlled by a readout control signal and stores the levels of the readout row selection signal vp_vsel(1) and the reset row selection signal vp_res(1). The output signal of the readout control unit 351 is a signal for resetting the counter 14 of the pixel P in the corresponding row and connecting it to the signal line pOUT.
[0066] The exposure start row selection signal vp_exp_str(1) output from the third decoder unit 33 is input to the exposure start control unit 352. The exposure start control unit 352 stores the level of the exposure start row selection signal vp_exp_str(1). The output signal of the exposure start control unit 352 is a signal (start signal) for starting exposure of the pixels P in the corresponding row.
[0067] The pixel drive signal generation unit 354 receives the read row selection signal vp_vsel(1) and reset row selection signal vp_res(1) stored in the read control unit 351. The pixel drive signal generation unit 354 also receives the exposure start row selection signal vp_exp_str(1) stored in the exposure start control unit 352 and the exposure end row selection signal vp_exp_stop(1) stored in the exposure end control unit 353. These signals are used to perform readout, reset processing, exposure start processing, and exposure end processing for the corresponding pixel rows. The timing of these processes is controlled by signals input to the pixel drive signal generation unit 354. The pixel drive signal generation unit 354 outputs the pixel drive signals required for these processes to the corresponding pixel rows. The pixel drive signals output from the pixel drive signal generation unit 354 are the signal pCLK[1], the signal pVSEL[1], and the signal pRES[1]. Here, one pixel drive signal generation section 354 is configured to drive one row of the pixel section 10, but may be configured to drive two or more rows.
[0068] [Pixel drive signal operation] The operation of the photoelectric conversion device according to the first embodiment shown in FIG. 1 will be described.
[0069] 6 is a timing chart showing an example of the operation of the vertical scanning control section 22, the vertical scanning section 30, and the pixel section 10. The operation will be described below with reference to FIG.
[0070] <<Input of vertical scanning control unit 22>> First, the CPU 70 executes a program, and a signal for controlling the photoelectric conversion device 100 is supplied to the control unit 20.
[0071] In response to this, a synchronization signal generation unit 21 in the control unit 20 generates a vertical synchronization signal VD, a horizontal synchronization signal HD, and a clock MCLK. These signals are supplied to a vertical scanning control unit 22, a signal processing control unit 23, and a horizontal scanning control unit 24.
[0072] 《cnt_HD》 At time t100, when the vertical synchronization signal VD transitions to a high level, the counter value cnt_HD is initialized to a value of 0 based on this.
[0073] At time t101, when the horizontal synchronization signal HD transitions to high level, the counter value cnt_HD counts up based on this and transitions to the value 1. The counter value cnt_HD counts up every time the horizontal synchronization signal HD transitions to high level.
[0074] 《cnt_P_CLK》 At time t100, when the vertical synchronization signal VD transitions to high level, the pulse counting unit 223 starts counting the signal P_CLK.
[0075] At time t101, when the signal P_CLK transitions to high level, the counter value cnt_P_CLK is initialized to the value zero.
[0076] At time t103, when the signal P_CLK transitions to high level, the counter value cnt_P_CLK counts up based on this and transitions to the value 1. The counter value cnt_P_CLK counts up every time the signal P_CLK transitions to high level.
[0077] <<Reset process>> At time t101, based on cnt_HD=1, the signal P_RES transitions to a value of 0. The value 0 is a predetermined setting value, and may be configured to be controllable by a register or the like. Furthermore, the timing at which the signal P_RES transitions to a value of 0 does not necessarily have to be when the counter value cnt_HD is 1, and may be configured to be controllable by a register or the like.
[0078] At time t102, when the horizontal synchronization signal HD transitions to a high level, the signal P_RES transitions (counts up) to a value of 1 based on this. The width of the transition does not necessarily have to be +1, and the transition may also be to a specific value. The settings of these transitions may be configured to be controllable using setting information held in a register. Thereafter, the signal P_RES counts up (+1) every time the horizontal synchronization signal HD transitions to a high level.
[0079] Furthermore, at time t101, when the value of the signal P_RES transitions to 0, the signal pRES[1] transitions to high level, and the first row of the pixel unit 10 becomes the target row for the reset process. The signal pRES[1] controls the counter 14 of the pixel P, and if it is high level, resets the count value held in the counter 14.
[0080] At time t104, when the value of the signal P_RES transitions to the value 1, the first row of the pixel unit 10 is no longer the target row for the reset process, and the signal pRES[1] transitions to low level.
[0081] 《cnt_P_CLK》 At time t103, when the value of the signal P_EXP_STR transitions to the value 0, the pulse counting unit 355 starts counting the signal P_CLK.
[0082] At time t104, when the signal P_CLK transitions to high level, the counter value cnt_P_CLK is initialized to the value zero.
[0083] At time t105, when the signal P_CLK transitions to high level, the counter value cnt_P_CLK counts up based on this and transitions to the value 1. The counter value cnt_P_CLK counts up every time the signal P_CLK transitions to high level.
[0084] <<Exposure start processing and exposure end processing>> At time t103, the value of signal P_EXP_STR transitions to the value 0. This causes signal P_SH1 to transition to high level and signal P_SH2 to transition to low level. At time t112, when the value of signal P_EXP_STR transitions to the value 0, signal P_SH1 transitions to low level and signal P_SH2 transitions to high level based on this. Thereafter, signals P_SH1 and P_SH2 toggle each time the value of signal P_EXP_STR transitions to the value 0.
[0085] The timing at which the signals P_SH1 and P_SH2 toggle is not necessarily limited to when the signal P_EXP_STR has a value of 0. It may be configured so that it can be controlled by a set value held in a register or the like.
[0086] Furthermore, at time t103, when the value of the signal P_EXP_STR transitions to the value 0, the first row of the pixel unit 10 becomes the target row for the exposure start process, and the supply of the signal pCLK[1] starts. The signal pCLK[1] is generated using the signal P_CLK.
[0087] At time t107, the signal p_exp_stop[1] transitions to high level based on cnt_P_CLK[1] = 4. Note that the timing at which the signal p_exp_stop[1] transitions to high level is not necessarily limited to when the counter value cnt_P_CLK[1] is 4. It may also be configured to be controllable by another set value stored in a register or the like.
[0088] At time t107, when the signal p_exp_stop[1] transitions to high level, the first row of the pixel unit 10 becomes the target row for the exposure end process, and the supply of the signal pCLK[1] is terminated.
[0089] The period from time t104 to time t107 is the exposure time for the first row of the pixel unit 10. During this exposure time, the signal pCLK[1] controls the resistance value of the quench element 12 of the pixel P in the first row of the pixel unit 10. This controls the voltage supplied to the APD 11. Because the quench element 12 is a PMOS transistor, it is in an off state when the signal pCLK is at a high level and in an on state when the signal pCLK is at a low level.
[0090] Furthermore, at time t103, when the value of the signal P_EXP_STR transitions to 0, the first row of the pixel unit 10 becomes the target row for exposure start processing. As a result, the vertical scanning unit 30 starts supplying the signal pCLK[1]. The signal pCLK[1] is generated using the signal P_CLK. The signal pCLK[1] controls the quench element 12 of the pixel P in the first row of the pixel unit 10, and controls the voltage supplied to the APD 11. Because the quench element 12 is a PMOS transistor, it is in an off state when the signal pCLK is at a high level and in an on state when the signal pCLK is at a low level.
[0091] At time t107, the signal p_exp_stop[1] transitions to high level based on cnt_P_CLK[1] = 4. Note that the timing at which the signal p_exp_stop[1] transitions to high level is not necessarily limited to when the counter value cnt_P_CLK[1] is 4. It may also be configured to be controllable by another set value stored in a register or the like.
[0092] At time t107, when the signal p_exp_stop[1] transitions to high level, the exposure end process is performed on the first row of the pixel unit 10. The vertical scanning unit 30 stops supplying the signal pCLK[1].
[0093] The period from time t104 to time t107 is the exposure period for the first row of the pixel unit 10. During the exposure period, the signal pCLK[1] controls the operating state (resistance value) of the quenching element 12 of the pixel P in the first row of the pixel unit 10. This controls the voltage supplied to the APD 11.
[0094] <<Pixel drive signal operation>> At time t103, the value of the signal P_EXP_STR transitions to the value 0. At this timing, the signal P_SH1 is at a high level and the signal P_SH2 is at a low level, causing the signal p_sh[1] to transition to a high level.
[0095] At time t112, the value of the signal P_EXP_STR transitions to the value 0. At this timing, the signal P_SH1 is at a low level and the signal P_SH2 is at a high level, causing the signal p_sh[1] to transition to a low level.
[0096] The pulse signal selection unit 357 selects the signal P_CLK1 during the period from time t100 to time t102 when the signal p_sh[1] indicates a high level, and therefore outputs the signal P_CLK1 as the signal p_clk[1].
[0097] During the period when the signal p_sh[1] indicates a low level, the pulse signal selection unit 357 selects the signal P_CLK2 and outputs it as the signal p_clk[1].
[0098] At time t103, the value of the signal P_EXP_STR transitions to 0. As a result, the first row of the pixel unit 10 becomes the target row for exposure start processing, and the vertical scanning unit 30 starts supplying the signal pCLK[1]. The signal p_clk[1] is generated using the signal pCLK[1].
[0099] At time t106, the value of the signal P_EXP_STR transitions to the value 1. At this timing, the signal P_SH1 is at a high level and the signal P_SH2 is at a low level, causing the signal p_sh[2] to transition to a high level.
[0100] At time t113, the value of the signal P_EXP_STR transitions to the value 1. At this timing, the signal P_SH1 is at a low level and the signal P_SH2 is at a high level. At this time, the signal p_sh[2] transitions to a low level.
[0101] The pulse signal selection unit 357 selects the signal P_CLK1 during the period from time t106 when the signal p_sh[2] indicates a high level to time t113. As a result, the signal P_CLK1 is output as the signal p_clk[2].
[0102] During the period when the signal p_sh[2] indicates a low level, the pulse signal selection unit 357 selects the signal P_CLK2, which is then output as the signal p_clk[2].
[0103] Furthermore, at time t106, when the value of the signal P_EXP_STR transitions to the value 1, the second row of the pixel unit 10 becomes the target row for exposure start processing, and the supply of the signal pCLK[2] begins. The signal pCLK[2] is generated using the signal p_clk[2].
[0104] <<Reading process>> At time t110, based on cnt_HD=0, the signal P_VSEL transitions to a value of 0. The value 0 is a predetermined setting value, but is not limited to this example. It may also be configured to be controllable by another setting value stored in a register or the like. Furthermore, the timing at which the signal P_VSEL transitions to a value of 0 does not necessarily have to be when the counter value cnt_HD is 0. For example, the timing at which the signal P_VSEL transitions may be adjusted based on setting information stored in a register so that it coincides with the timing at which the counter value cnt_HD is a predetermined value.
[0105] At time t111, when the horizontal synchronization signal HD transitions to high level, the signal P_VSEL transitions to a value of 1 based on this. The width of the transition does not necessarily have to be +1, and the transition may also be to a specific value. These may be configured to be controllable by another set value held in a register or the like. Thereafter, the signal P_VSEL is counted up (+1) each time the horizontal synchronization signal HD transitions to high level.
[0106] Furthermore, at time t110, when the value of the signal P_VSEL transitions to 0, the signal pVSEL[1] transitions to high level. As a result, the first row of the pixel unit 10 becomes the target row for readout processing. The signal pVSEL[1] controls the pixel output circuit 15 of the pixel P, and when it is high level, the counter 14 and the signal line pOUT are connected, and the count value is read out.
[0107] At time t111, when the value of the signal P_VSEL transitions to the value 1, the first row of the pixel unit 10 is no longer the target row for the readout process, and the signal pVSEL[1] transitions to low level.
[0108] <<Transition of target rows for each process>> At time t102, when the value of the signal P_RES transitions to the value 1, the second row of the pixel section 10 becomes the target row for the reset process.
[0109] At time t103, when the value of the signal P_EXP_STR transitions to the value 1, the second row of the pixel section 10 becomes the target row for exposure start processing.
[0110] At time t109, when the value of the signal P_EXP_STOP transitions to the value 1, the second row of the pixel unit 10 becomes the target row for the exposure end process. As a result, the vertical scanning unit 30 stops supplying the signal pCLK[2].
[0111] At time t111, when the value of the signal P_VSEL transitions to value 1, the second row of the pixel section 10 becomes the target row for the readout process.
[0112] The operation of the second row of the pixel section 10 is the same as the operation of the first row of the pixel section 10.
[0113] According to this embodiment, the vertical scanning timing control section 22 includes a pulse signal generation section 221 that generates a plurality of signals P_CLK1 and P_CLK2 with different cycles.
[0114] Consider a case where, instead of generating signals P_CLK1 and P_CLK2 as in this embodiment, the period of signal MCLK is changed. In this case, signal MCLK is a signal commonly used for all pixel rows. If the period of signal MCLK is changed before the exposure periods of all pixel rows have ended, the exposure periods of pixel rows before the end of exposure will change. As a result, the resulting images will have exposure periods of different lengths, resulting in brightness differences within the image. For this reason, the period of signal MCLK is changed after the exposure periods of all pixel rows have ended.
[0115] On the other hand, in this embodiment, as described above, multiple signals P_CLK1 and P_CLK2 with different cycles are generated, which makes it possible to change the length of the exposure period for pixel rows from which signals have already been read out before the end of the exposure period for all pixel rows.
[0116] Furthermore, in this embodiment, the selection of clock signals by the selection unit can be changed during a period in which readout scanning is performed to read out signals from pixels P in multiple rows. In other words, during a period in which signals are read out from pixels P in some rows, the selection unit corresponding to pixels P in another portion of rows can change the clock signal to be output from among multiple clock signals. This allows the timing at which the length of the exposure period can be changed even during readout scanning.
[0117] In this way, in this embodiment, the length of the exposure period can be suitably changed.
[0118] Furthermore, in this embodiment, a selection holding unit 356 is provided corresponding to each row of pixels P, but this is not limited to this example. For example, a single selection holding unit 356 may be shared by a plurality of row driving units 35 corresponding to two or more pixel rows. Even in this case, the length of the exposure period can be changed in units of pixel rows for which this selection holding unit 356 is provided.
[0119] In this embodiment, the signals P_CLK1 and P_CLK2 are generated inside the photoelectric conversion device, but the present invention is not limited to this example. For example, the signals P_CLK1 and P_CLK2 may be supplied to the photoelectric conversion device from a generation circuit provided outside the photoelectric conversion device. In this case, the photoelectric conversion device is provided with an external input pad (external connection terminal) to which the signal P_CLK1 is input, and an external input pad (external connection terminal) to which the signal P_CLK2 is input.
[0120] In addition, in this embodiment, the quench circuit unit 19 is configured only by the quench element 12, but the present invention is not limited to this example. As shown in Fig. 7(a), the quench circuit unit 19 may also include a switch 17 and a resistance element 18. In this case, the signal pCLK described in this embodiment is input to the switch 17. The switch 17 is configured by a PMOS transistor, but the present invention is not limited to this example and may be any element that functions as a switch.
[0121] 7B, the switch 17 may include multiple transistors. In this case, a voltage VH is input to one transistor, and a voltage V0 is input to the other transistor. The voltage V0 is closer to the voltage VL than the voltage VH. When the voltage V0 is input to the APD 11, avalanche multiplication does not occur. When the voltage VH is input to the resistor element 18, the APD 11 performs a quenching operation. On the other hand, when the voltage V0 is input to the resistor element 18, the APD 11 does not perform a quenching operation. A signal pCLK is input to the gates of the multiple transistors. In this configuration, the multiple transistors whose gates receive the signal pCLK have different conductivity types. However, this is not limiting. For example, the signal pCLK may be input to the gate of one transistor. Then, an inverter circuit may invert the signal pCLK and input it to the gate of the other transistor.
[0122] Second Embodiment Next, a photoelectric conversion device according to a second embodiment of the present disclosure will be described, focusing on differences from the first embodiment, with reference to Figures 8 to 11. This embodiment has different configurations of the pixels P, the vertical scanning timing control unit 22, and the vertical scanning unit 30 from those of the first embodiment.
[0123] [Pixel P(m,n)] FIG. 8 is a diagram showing the configuration of a pixel P(m,n) according to the second embodiment.
[0124] In this embodiment, pixel P(m,n) has a memory unit 16. A signal pMEM[n] is supplied to memory unit 16 from vertical scanning unit 30 via a drive line. This signal pMEM switches the operation of memory unit 16 between an operation of updating the signal value it holds with the signal value output from counting unit 14 and an operation of holding the signal value. In addition, the output value of memory unit 16 is input to selection circuit 15.
[0125] [Vertical scanning timing control section 22] FIG. 9 is a diagram showing the configuration of the vertical scanning timing control unit 22 according to the second embodiment.
[0126] In this embodiment, the start trigger generation unit 226 generates a signal TRG_STR as an exposure start trigger signal and outputs it to the vertical scanning unit 30. The signal TRG_STR is a trigger signal that indicates the start of exposure and can be used in common for all pixel rows in the pixel unit 10. The signal TRG_STR may also be generated by the CPU 70. Furthermore, the pulse signal generation unit 221 in the vertical scanning timing control unit 22 generates signals P_CLK1, P_CLK2, P_CLK3, and P_CLK4. The period of each signal can be controlled based on one cycle of the signal MCLK. Furthermore, each signal can be set to a different period.
[0127] Furthermore, the selection generation unit 228 generates 2N pulse signal selection information signals, P_SH_L(1) to (N) and P_SH_R(1) to (N), in accordance with the timing of the signal TRG_STR. The suffixes "L" and "R" of the pulse signal selection information signals correspond to the first and second regions, respectively, when the pixel unit 10 is divided horizontally into two halves. The first region is the left region from the first column to the (M / 2)th column. The second region is the right region from the (M / 2)+1th column to the Mth column. However, the number of divided regions is not limited to two and may be three or more. In this case, the number of pulse signal selection information signals can be increased appropriately.
[0128] Alternatively, the pulse signal generation unit 221 may output the signals P_CLK_L[1] to [N] and P_CLK_R[1] to [N] corresponding to each pixel region. In this case, the selection generation unit 228, the signals P_SH_L, P_SH_R, and P_CLK1 to 4 can be omitted. In this case, the signal TRG_STR is input to the pulse signal generation unit 221. The period of each pulse signal is changed according to the timing of this signal TRG_STR. In this case, the pulse signals P_CLK_L[1] to [N] and P_CLK_R[1] to [N] can be driven in the same way as the pulse signals p_clk_L[1] to [N] and p_clk_R[1] to [N] in FIG. 10, which will be described later.
[0129] [Vertical scanning unit 30] FIG. 10 is a configuration diagram of a vertical scanning unit 30 according to the second embodiment. In this embodiment, the vertical scanning unit 30 is configured without the second decoder unit 32, the third decoder unit 33, and the exposure start control unit 352. Instead of the signal P_CLK, the vertical scanning unit 30 receives signals P_CLK1, P_CLK2, P_CLK3, and P_CLK4, which are commonly input to the row driving units 35 for all rows. The configuration may be modified as appropriate so that the number of signals P_CLK is five or more. Instead of receiving signals P_SH1 and P_SH2, the selection holding unit 356 receives corresponding signals from among signals P_SH_L(1)-(N) and P_SH_R(1)-(N). The signal P_EXP_STR is input to the pulse counting unit 355, not to the selection holding unit 356.
[0130] Furthermore, the signals P_MEM and P_RES are input in common to the pixel drive signal generation units 354 for all rows.
[0131] The pixel unit 10 is divided horizontally into a first region (here, the left region from the 1st column to the M / 2th column) and a second region (here, the right region from the (M / 2)+1th column to the Mth column). Signals pCLK_L and pCLK_R are supplied to the first region and the second region, respectively. Note that the number of regions may be three or more, in which case signals pCLK are added as appropriate.
[0132] In this embodiment as well, the pulse signal selection unit 357 is a selection unit that selects a clock signal to be output from a plurality of input clock signals with different cycles.
[0133] [Pixel drive signal operation] 11 is a timing chart showing an example of the operation of the vertical scanning timing control section 22, the vertical scanning section 30, and the pixel section 10 according to the second embodiment. Hereinafter, the operation will be described with reference to FIG.
[0134] At time t100, the vertical synchronization signal VD transitions to a high level. Following this transition, the signal p_MEM transitions to a high level. As a result, the signals pMEM for each pixel row transition to a high level simultaneously for all pixel rows.
[0135] At time t101, when the signal p_MEM transitions to low level, the signal pMEM also transitions to low level, and the signal p_RES transitions to high level, and based on this, the signals pRES for each pixel row simultaneously transition to high level.
[0136] At time t102, when the signal TRG_STR transitions to a high level, the supply of the signals pCLK_L and pCLK_R for each row begins. Furthermore, the levels of the signals P_SH_L(1), P_SH_R(1) to P_SH_L(N), P_SH_R(N) transition. Here, P_SH_L(1) has a value of 0, P_SH_R(1) has a value of 1, P_SH_L(2) has a value of 0, P_SH_R(2) has a value of 1, P_SH_L(N) has a value of 2, and P_SH_R(N) has a value of 3. Note that these values may be different. Here, the pulse signal selector 357 selects P_CLK1 when the pulse signal selection information signal is a value of 0, selects P_CLK2 when the pulse signal selection information signal is a value of 1, selects P_CLK3 when the pulse signal selection information signal is a value of 2, and selects P_CLK4 when the pulse signal selection information signal is a value of 3. Note that this selection may be performed in a different manner.
[0137] Furthermore, at time t102, when the signal TRG_STR transitions to high level, the pulse counting unit 355 starts counting the signals p_clk_L and p_clk_R.
[0138] At time t103, when the counter value cnt_P_CLK_L[N] transitions to the value 11, the signal p_exp_stop_L[N] transitions to a high level. Note that the timing at which the signal p_exp_stop_L[N] transitions to a high level is not necessarily limited to when the counter value cnt_P_CLK_L[N] is 11. It may also be configured so that it can be controlled by another set value stored in a register or the like.
[0139] At time t103, when the signal p_exp_stop_L[N] transitions to high level, the supply of the signal pCLK_L[N] corresponding to the 1st to M / 2nd columns in the Nth row of the pixel section 10 is terminated.
[0140] At time t104, when the counter values cnt_P_CLK_L[1] and cnt_P_CLK_L[2] transition to 10, the signals p_exp_stop_L[1] and p_exp_stop_L[2] transition to high level. Note that the timing at which the signals p_exp_stop_L[1] and p_exp_stop_L[2] transition to high level is not necessarily limited to when the counter values cnt_P_CLK_L[1] and cnt_P_CLK_L[2] are 10. A configuration in which they can be controlled by another set value held in a register or the like is also possible.
[0141] At time t104, the signals p_exp_stop_L[1] and p_exp_stop_L[2] transition to high level, thereby terminating the supply of the signals pCLK_L[1] and pCLK_L[2] corresponding to the first to M / 2 columns of the first and second rows of the pixel unit 10.
[0142] At time t105, the counter values cnt_P_CLK_R[1] and cnt_P_CLK_R[2] transition to a value of 9. This causes the signals p_exp_stop_R[1] and p_exp_stop_R[2] to transition to a high level. Note that the timing at which the signals p_exp_stop_R[1] and p_exp_stop_R[2] transition to a high level is not necessarily limited to when the counter values cnt_P_CLK_R[1] and cnt_P_CLK_R[2] are 9. A configuration in which this can be controlled by another set value stored in a register or the like is also possible.
[0143] At time t105, the signals p_exp_stop_R[1] and p_exp_stop_R[2] transition to high level, thereby terminating the supply of the signals pCLK_R[1] and pCLK_R[2] corresponding to the (M / 2)+1 to M columns of the first and second rows of the pixel unit 10.
[0144] At time t106, when the counter value cnt_P_CLK_R[N] transitions to the value 8, the signal p_exp_stop_R[N] transitions to the high level. Note that the timing at which the signal p_exp_stop_R[N] transitions to the high level is not necessarily limited to when the counter value cnt_P_CLK_R[N] is the value 8. It may also be configured so that it can be controlled by another set value stored in a register or the like.
[0145] At time t106, when the signal p_exp_stop_R[N] transitions to high level, the supply of the signal pCLK_R[N] corresponding to the (M / 2)+1th to Mth columns in the Nth row of the pixel section 10 is terminated.
[0146] By selecting the period and exposure time settings of the pCLK supplied to pixel P according to each pixel area, it is possible to individually control the exposure time of each area controlled by each pCLK in units of one cycle of the signal P_CLK.
[0147] At time t107, p_MEM transitions to high level, and based on this, the signal pMEM for each pixel row simultaneously transitions to high level, causing the memory unit 16 to hold the count value of each pixel due to the exposure that started at time t102.
[0148] At time t108, the signal p_MEM transitions to low level. This causes the signal pMEM to also transition to low level. The signal p_RES then transitions to high level, and based on this, the signals pRES for each pixel row simultaneously transition to high level. This resets the count value of each pixel due to the exposure that began at t102. In addition, p_VSEL transitions to 0, and based on this, pVSEL[1] transitions to high level. This causes the count value held in the pixels in the first row to be read out. Thereafter, the count values of each row are read out sequentially according to the value of p_VSEL.
[0149] At time t109, when signal TRG_STR transitions to high level, pulse count unit 355 starts counting signals p_clk_L and p_clk_R. Note that the values of signals P_SH_L and P_SH_R may be changed from their values at time t102. In that case, the exposure period of the exposure started at t109 will be different in length from the exposure period of the exposure started at t102.
[0150] This embodiment realizes a pixel driving method (so-called global shutter) in which exposure starts and ends simultaneously for all rows. Furthermore, the selector selects a clock signal to be used for each pixel region from among multiple clock signals with different cycles. This allows the exposure period for each pixel region to be changed while still achieving the effects of the first embodiment. This makes it possible to capture images with exposure periods of lengths appropriate for each region, even when there are differences in brightness between regions of the subject.
[0151] <Third embodiment> The photoelectric conversion system according to this embodiment will be described with reference to Fig. 12. Fig. 12 is a block diagram showing a schematic configuration of the photoelectric conversion system according to this embodiment.
[0152] The imaging devices described in the first and second embodiments can be applied to various photoelectric conversion systems. Examples of applicable photoelectric conversion systems include digital still cameras, digital camcorders, surveillance cameras, copiers, fax machines, mobile phones, vehicle-mounted cameras, and observation satellites. Also included in the photoelectric conversion system is a camera module equipped with an optical system such as a lens and an imaging device. Fig. 12 illustrates a block diagram of a digital still camera as an example of such systems.
[0153] 12 includes an imaging device 1004, a lens 1002 that forms an optical image of a subject on the imaging device 1004, an aperture 1003 that adjusts the amount of light passing through the lens 1002, and a barrier 1001 that protects the lens 1002. The lens 1002 and the aperture 1003 form an optical system that focuses light on the imaging device 1004. The imaging device 1004 is a photoelectric conversion device (imaging device) according to any of the above embodiments, and converts the optical image formed by the lens 1002 into an electrical signal.
[0154] The photoelectric conversion system also includes a signal processing unit 1007, which is an image generation unit that generates an image by processing an output signal output from the imaging device 1004. The signal processing unit 1007 performs various corrections and compressions as necessary to output image data. The signal processing unit 1007 may be formed on the same semiconductor substrate on which the imaging device 1004 is provided, or may be formed on a semiconductor substrate separate from the imaging device 1004. Alternatively, the imaging device 1004 and the signal processing unit 1007 may be formed on the same semiconductor substrate.
[0155] The photoelectric conversion system further includes a memory unit 1010 for temporarily storing image data, and an external interface unit (external I / F unit) 1013 for communicating with an external computer or the like. The photoelectric conversion system further includes a recording medium 1012 such as a semiconductor memory for recording or reading out imaging data, and a recording medium control interface unit (recording medium control I / F unit) 1011 for recording or reading out data from the recording medium 1012. The recording medium 1012 may be built into the photoelectric conversion system or may be detachable.
[0156] The photoelectric conversion system further includes an overall control and calculation unit 1009 that performs various calculations and controls the entire digital still camera, and a timing generation unit 1008 that outputs various timing signals to the image capture device 1004 and the signal processing unit 1007. Here, timing signals and the like may be input from outside, and the photoelectric conversion system only needs to include at least the image capture device 1004 and the signal processing unit 1007 that processes the output signal output from the image capture device 1004.
[0157] The imaging device 1004 outputs an imaging signal to a signal processing unit 1007. The signal processing unit 1007 performs predetermined signal processing on the imaging signal output from the imaging device 1004 and outputs image data. The signal processing unit 1007 generates an image using the imaging signal.
[0158] As described above, according to this embodiment, it is possible to realize a photoelectric conversion system to which the photoelectric conversion device (imaging device) according to any one of the above embodiments is applied.
[0159] <Fourth embodiment> The photoelectric conversion system and the moving object of this embodiment will be described with reference to Fig. 13. Fig. 13 is a diagram showing the configuration of the photoelectric conversion system and the moving object of this embodiment.
[0160] FIG. 13(a) shows an example of a photoelectric conversion system related to an in-vehicle camera. The photoelectric conversion system 300 includes an image capture device 310. The image capture device 310 is the photoelectric conversion device (image capture device) described in any of the above embodiments. The photoelectric conversion system 300 includes an image processing unit 312 that performs image processing on multiple pieces of image data acquired by the image capture device 310, and a parallax acquisition unit 314 that calculates parallax (phase difference between parallax images) from the multiple pieces of image data acquired by the photoelectric conversion system 300. The photoelectric conversion system 300 also includes a distance acquisition unit 316 that calculates the distance to an object based on the calculated parallax, and a collision determination unit 318 that determines whether or not there is a possibility of a collision based on the calculated distance. Here, the parallax acquisition unit 314 and the distance acquisition unit 316 are examples of distance information acquisition means that acquire information about the distance to the object. That is, the distance information is information about the parallax, the defocus amount, the distance to the object, etc. The collision determination unit 318 may determine the possibility of a collision using any of this distance information. The distance information acquisition means may be realized by dedicated hardware, a software module, a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), or a combination thereof.
[0161] The photoelectric conversion system 300 is connected to a vehicle information acquisition device 320 and can acquire vehicle information such as vehicle speed, yaw rate, and steering angle. The photoelectric conversion system 300 is also connected to a control ECU 330, which is a control device that outputs a control signal to generate a braking force for the vehicle based on the determination result of the collision determination unit 318. The photoelectric conversion system 300 is also connected to an alarm device 340 that issues an alarm to the driver based on the determination result of the collision determination unit 318. For example, if the determination result of the collision determination unit 318 indicates a high possibility of a collision, the control ECU 330 performs vehicle control to avoid the collision and mitigate damage by applying the brakes, releasing the accelerator, suppressing engine output, etc. The alarm device 340 warns the user by sounding an alarm, displaying alarm information on a screen such as a car navigation system, or vibrating the seat belt or steering wheel.
[0162] In this embodiment, the surroundings of the vehicle, for example, the front or rear, are imaged by the photoelectric conversion system 300. Fig. 13(b) shows the photoelectric conversion system when imaging the area in front of the vehicle (imaging range 350). The vehicle information acquisition device 320 sends instructions to the photoelectric conversion system 300 or the imaging device 310. This configuration can further improve the accuracy of distance measurement.
[0163] Although the above describes an example of control to prevent collision with other vehicles, the present invention can also be applied to control of automatic driving by following other vehicles, and control of automatic driving to prevent deviation from a lane. Furthermore, the photoelectric conversion system is not limited to vehicles such as the subject vehicle, but can be applied to moving bodies (moving devices) such as ships, aircraft, and industrial robots. In addition, the present invention can be applied not only to moving bodies but also to a wide range of devices that use object recognition, such as intelligent transport systems (ITS).
[0164] [Modified embodiment] The present disclosure is not limited to the above-described embodiment, and various modifications are possible.
[0165] For example, an example in which part of the configuration of any one embodiment is added to another embodiment, or an example in which part of the configuration of another embodiment is replaced with another embodiment, is also included in the embodiments of the present disclosure.
[0166] Furthermore, the photoelectric conversion systems shown in the third and fourth embodiments are examples of photoelectric conversion systems to which the photoelectric conversion device can be applied, and photoelectric conversion systems to which the photoelectric conversion device of the present disclosure can be applied are not limited to the configurations shown in Figures 12 and 13.
[0167] It should be noted that the above-described embodiments are merely examples of specific embodiments for carrying out the present disclosure, and the technical scope of the present disclosure should not be construed as being limited by these embodiments. In other words, the present disclosure can be carried out in various forms without departing from its technical concept or main features.
[0168] Fifth Embodiment This embodiment can be applied to any of the first and second embodiments. FIG. 14(a) is a schematic diagram illustrating a device 9191 including a photoelectric conversion device 930 of this embodiment. The photoelectric conversion device 930 can be any of the photoelectric conversion devices described in the first to seventh embodiments, or a photoelectric conversion device that combines multiple embodiments. The device 9191 including the photoelectric conversion device 930 will be described in detail. As described above, the photoelectric conversion device 930 can include a semiconductor device 910 having a semiconductor layer 10, as well as a package 920 that houses the semiconductor device 910. The package 920 can include a base to which the semiconductor device 910 is fixed and a lid such as glass that faces the semiconductor device 910. The package 920 can further include bonding members such as bonding wires and bumps that connect terminals provided on the base to terminals provided on the semiconductor device 910.
[0169] The equipment 9191 can include at least one of an optical device 940, a control device 950, a processing device 960, a display device 970, a storage device 980, and a mechanical device 990. The optical device 940 corresponds to the photoelectric conversion device 930. The optical device 940 is, for example, a lens, a shutter, or a mirror. The control device 950 controls the photoelectric conversion device 930. The control device 950 is, for example, a photoelectric conversion device such as an ASIC.
[0170] The processing device 960 processes the signal output from the photoelectric conversion device 930. The processing device 960 is a photoelectric conversion device such as a CPU or ASIC for configuring an AFE (analog front end) or a DFE (digital front end). The display device 970 is an EL display device or a liquid crystal display device that displays information (images) obtained by the photoelectric conversion device 930. The storage device 980 is a magnetic device or a semiconductor device that stores information (images) obtained by the photoelectric conversion device 930. The storage device 980 is a volatile memory such as an SRAM or a DRAM, or a non-volatile memory such as a flash memory or a hard disk drive.
[0171] The mechanical device 990 has a moving part or a propulsion part such as a motor or an engine. In the device 9191, the signal output from the photoelectric conversion device 930 is displayed on the display device 970, or transmitted to the outside by a communication device (not shown) provided in the device 9191. For this purpose, the device 9191 preferably further includes a storage device 980 and a processing device 960 in addition to the memory circuit and arithmetic circuit provided in the photoelectric conversion device 930. The mechanical device 990 may be controlled based on the signal output from the photoelectric conversion device 930.
[0172] The device 9191 is also suitable for electronic devices such as information terminals with a photographing function (for example, smartphones and wearable devices) and cameras (for example, interchangeable lens cameras, compact cameras, video cameras, and surveillance cameras). The mechanical device 990 in the camera can drive components of the optical device 940 for zooming, focusing, and shutter operation. Alternatively, the mechanical device 990 in the camera can move the photoelectric conversion device 930 for vibration isolation.
[0173] Furthermore, the device 9191 may be transportation equipment such as a vehicle, a ship, or an aircraft. The mechanical device 990 in transportation equipment can be used as a moving device. The device 9191 as transportation equipment is suitable for transporting the photoelectric conversion device 930 or for assisting and / or automating driving (piloting) using an imaging function. The processing device 960 for assisting and / or automating driving (piloting) can perform processing for operating the mechanical device 990 as a moving device based on information obtained by the photoelectric conversion device 930. Alternatively, the device 9191 may be a medical device such as an endoscope, a measuring device such as a distance measuring sensor, an analytical device such as an electron microscope, an office machine such as a copier, or an industrial device such as a robot.
[0174] According to the above-described embodiment, it is possible to obtain good pixel characteristics. Therefore, the value of the photoelectric conversion device can be increased. In this case, increasing the value corresponds to at least one of adding functions, improving performance, improving characteristics, improving reliability, improving manufacturing yield, reducing environmental impact, reducing costs, reducing size, and reducing weight.
[0175] Therefore, if the photoelectric conversion device 930 according to this embodiment is used in equipment 9191, the value of the equipment can also be improved. For example, by installing the photoelectric conversion device 930 in transportation equipment, excellent performance can be obtained when photographing the exterior of the transportation equipment or measuring the external environment. Therefore, when manufacturing and selling transportation equipment, deciding to install the photoelectric conversion device according to this embodiment in the transportation equipment is advantageous in terms of improving the performance of the transportation equipment itself. In particular, the photoelectric conversion device 930 is suitable for transportation equipment that performs driving assistance and / or automatic driving of the transportation equipment using information obtained by the photoelectric conversion device. [Explanation of symbols]
[0176] 10 Pixel section 11 Avalanche photodiode 12 Quench element 13 Waveform shaping circuit 14 Counter 15 Pixel output circuit 20 Control Unit 22 Vertical scanning control section 30 Vertical scanning unit 40 Signal holding section 50 horizontal scanning unit (second scanning unit) 60 Output section 70 CPU (calculation section) 100 Photoelectric conversion device
Claims
1. a quench circuit unit to which a signal defining the start and end of an exposure period is input, and a pixel unit in which a plurality of pixels each having an avalanche photodiode connected to the quench circuit unit are arranged across a plurality of rows; a selection unit that receives a plurality of clock signals having different cycles in parallel and selects one type of clock signal to be output during a certain exposure period from the plurality of clock signals; a generating unit that generates the signal using the clock signal output from the selecting unit; A photoelectric conversion device comprising:
2. a reference clock signal is input to the photoelectric conversion device; The photoelectric conversion device according to claim 1 , further comprising a generating unit that generates the plurality of clock signals in parallel using the reference clock signal.
3. 2. The photoelectric conversion device according to claim 1, further comprising a plurality of pads to which the plurality of clock signals are input in parallel from outside the photoelectric conversion device.
4. the clock signal selected by a selection unit corresponding to pixels in some rows among the plurality of rows; The photoelectric conversion device according to any one of claims 1 to 3, characterized in that the period of the clock signal selected by the selection unit corresponding to pixels of another part of the rows among the plurality of rows is different from that of the clock signal selected by the selection unit corresponding to pixels of another part of the rows.
5. 5. The photoelectric conversion device according to claim 1, wherein the selection section performs the selection in accordance with a trigger signal that controls the start of the exposure period.
6. 6. The photoelectric conversion device according to claim 1, wherein the length of the exposure period is controlled using the clock signal selected by the selection section.
7. a pulse counting unit that generates a count value by counting the clock signal selected by the selection unit; 7. The photoelectric conversion device according to claim 1, further comprising an exposure end control unit that controls the end of the exposure period based on the count value.
8. each of the plurality of pixels comprises a transistor having a gate; a pixel drive signal generation unit that supplies a control signal to the gate; 8. The photoelectric conversion device according to claim 7, wherein the exposure end control unit outputs a signal to the pixel drive signal generation unit to control the end of the exposure period.
9. a scanning unit that scans the plurality of rows in units of one row or two or more rows; the scanning unit includes a plurality of row driving units each corresponding to a portion of the plurality of rows; 9. The photoelectric conversion device according to claim 8, wherein each of the plurality of row driving sections includes the pixel driving signal generating section and the exposure end control section.
10. The photoelectric conversion device according to claim 9 , wherein each of the plurality of row driving units includes the pulse counting unit.
11. During the exposure period of pixels in some rows of the plurality of rows, A photoelectric conversion device according to any one of claims 1 to 10, characterized in that the selection unit corresponding to pixels in another part of the plurality of rows changes the clock signal output from among the plurality of clock signals to another clock signal.
12. During a period in which signals are read out from pixels in some of the rows, A photoelectric conversion device according to any one of claims 1 to 10, characterized in that the selection unit corresponding to pixels in another part of the plurality of rows changes the clock signal output from among the plurality of clock signals to another clock signal.
13. 13. The photoelectric conversion device according to claim 1, wherein the exposure period starts simultaneously for the plurality of rows.
14. 14. The photoelectric conversion device according to claim 13, wherein the exposure period is ended simultaneously for the plurality of rows.
15. 15. The photoelectric conversion device according to claim 1, wherein the quench circuit section includes a quench element that is a transistor to which the signal is input at a gate.
16. 15. The photoelectric conversion device according to claim 1, wherein the quench circuit comprises a switch controlled by the signal and a resistive element connected to the switch.
17. The photoelectric conversion device according to any one of claims 1 to 16, a signal processing unit that generates an image using a signal output from the photoelectric conversion device.
18. A moving object equipped with the photoelectric conversion device according to any one of claims 1 to 16, A moving body comprising a control unit that controls the movement of the moving body using a signal output from the photoelectric conversion device.
19. An apparatus comprising the photoelectric conversion device according to any one of claims 1 to 16, an optical device corresponding to the photoelectric conversion device; a control device that controls the photoelectric conversion device; a processing device that processes a signal output from the photoelectric conversion device; a display device that displays information obtained by the photoelectric conversion device; a storage device that stores information obtained by the photoelectric conversion device; and and a mechanical device that operates based on information obtained by the photoelectric conversion device. The device further comprises:
Citation Information
Patent Citations
Solid-state image pickup element
JP1995067043A
Image pickup device
JP2002027303A
Imaging apparatus, imaging element and imaging control method, and program
JP2012175234A
Photoelectric conversion device, imaging system, and moving body
JP2020123847A
Solid-state image pickup device and camera
WO2010137244A1