Photoelectric conversion device and photoelectric conversion system

The photoelectric conversion device integrates a photon detection element, counter, and flag signal generation to enhance functionality and reduce pixel size, achieving efficient and compact pixel operation.

JP2024163733APending Publication Date: 2024-11-22CANON KK
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2023079585
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-12
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

There is a challenge in improving pixel functionality in photoelectric conversion devices while reducing pixel size, as enhancing functionality often leads to increased pixel size.

Method used

The photoelectric conversion device incorporates a photodetection section with a photon detection element, a counter to count its output, and a flag signal generation section that resets the counter when a predetermined count value is reached, along with a readout circuit to detect events based on flag signals, allowing for efficient pixel operation and reduced size.

Benefits of technology

This configuration enhances pixel functionality while minimizing pixel size, improving integration and photon detection efficiency without sacrificing performance.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024163733000001_ABST
    Figure 2024163733000001_ABST
Patent Text Reader

Abstract

To provide technology advantageous for increasing pixel functionality and reducing a pixel size.SOLUTION: A photoelectric conversion device includes a photodetection unit including a photon detection element, a counter that counts output of the photodetection unit, and a flag signal generation unit that resets the counter and generates a flag signal when the count value of the counter reaches a predetermined value.SELECTED DRAWING: Figure 6
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a photoelectric conversion device and a photoelectric conversion system. [Background technology]

[0002] Patent Document 1 discloses a photoelectric conversion device having avalanche photodiodes arranged in a matrix. The avalanche photodiode multiplies the signal charge excited by photons by several times to several million times by using the avalanche multiplication phenomenon that occurs due to a strong electric field induced in a pn junction of a semiconductor.

[0003] Patent Document 2 discloses an asynchronous solid-state imaging device that operates in response to detection of the occurrence of an event such as a change in the amount of light. The solid-state imaging device of Patent Document 2 has a detection pixel that detects the occurrence of an event, and a counting pixel that counts the number of photons incident on an avalanche photodiode when an event occurs. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2020-123847 A [Patent Document 2] JP 2020-096347 A Summary of the Invention [Problem to be solved by the invention]

[0005] In a photoelectric conversion device having pixels including photon detection elements such as avalanche photodiodes, there is a demand for improving pixel performance, but the pursuit of this demand creates a dilemma in that pixel size increases.

[0006] An object of the present invention is to provide a technique that is advantageous for improving pixel performance and reducing pixel size. [Means for solving the problem]

[0007] One aspect of the present invention relates to a photoelectric conversion device comprising: a photodetection unit including a photon detection element; a counter that counts an output of the photodetection unit; and a flag signal generation unit that resets the counter and generates a flag signal in response to a count value of the counter reaching a predetermined value. Effect of the Invention

[0008] According to the present invention, a technique is provided that is advantageous for increasing pixel functionality and reducing pixel size. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a block diagram showing a first configuration example of a photoelectric conversion device according to a first embodiment. [Diagram 2] FIG. 4 is a block diagram showing a second configuration example of the photoelectric conversion device according to the first embodiment. [Diagram 3] FIG. 2 shows an example of the configuration of a pixel. [Figure 4] 1 is a perspective view showing an example of the configuration of a photoelectric conversion device according to a first embodiment. [Diagram 5] 3A to 3C are diagrams illustrating a basic operation of a photoelectric conversion unit in the photoelectric conversion device according to the first embodiment. [Figure 6] FIG. 2 is a diagram showing a specific example of the configuration of a pixel in the photoelectric conversion device according to the first embodiment. [Figure 7] 4 is a timing chart illustrating a method of driving a pixel in the photoelectric conversion device according to the first embodiment. [Figure 8] 4 is a diagram showing a more specific example of the configuration of a counter and a flag signal generating circuit of a pixel in the photoelectric conversion device according to the first embodiment. FIG. [Figure 9] 8A to 8C are diagrams illustrating a method of driving a pixel in a photoelectric conversion device according to a second embodiment. [Figure 10] 13A to 13C are diagrams illustrating a method of driving a pixel in a photoelectric conversion device according to a third embodiment. [Figure 11]FIG. 13 is a diagram showing a specific example of the configuration of a pixel in a photoelectric conversion device according to a fourth embodiment. [Figure 12] FIG. 13 is a diagram showing a specific example of the configuration of a counter and a flag signal generating circuit of a pixel in a photoelectric conversion device according to a fourth embodiment. [Figure 13] FIG. 13 is a diagram showing a schematic configuration of a photoelectric conversion device according to a fifth embodiment. [Figure 14] FIG. 13 is a diagram showing a schematic configuration of a photoelectric conversion device according to a sixth embodiment. [Figure 15] FIG. 1 is a diagram showing an example of the configuration of a photoelectric conversion system. [Figure 16] FIG. 13 is a diagram showing another example of the configuration of a photoelectric conversion system. [Figure 17] FIG. 13 is a diagram showing yet another example of the configuration of the photoelectric conversion system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the invention according to the claims. Although the embodiments describe a number of features, not all of these features are essential to the invention, and the features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted. [First embodiment] A photoelectric conversion device 100 according to a first embodiment of the present disclosure will be described with reference to FIGS. 1 to 8. FIG. 1 is a block diagram illustrating a schematic configuration of the photoelectric conversion device 100. As illustrated in FIG. 1, the photoelectric conversion device 100 may include a pixel unit 10, a vertical scanning circuit 40, a readout circuit 50, a horizontal scanning circuit 60, a control unit 80, and an output circuit 90. In the following description, the photoelectric conversion device 100 is illustratively described as an asynchronous imaging device using a photon detection element such as an avalanche photodiode. However, the photoelectric conversion device 100 may be configured as another device. For example, the photoelectric conversion device 100 may be configured as a distance measuring device (e.g., a focus detection device, a distance measuring device using TOF (Time Of Flight)), a photometric device (e.g., a device that measures the amount of incident light), or the like.

[0011] The pixel unit 10 may have a plurality of pixels 12 arranged in an array to form a plurality of rows and a plurality of columns. As described later, each pixel 12 may include a photodetector including a photon detection element such as an avalanche photodiode, and a signal processor for processing a signal output from the photodetector. The number of the plurality of pixels 12 constituting the pixel unit 10 is not particularly limited. For example, the pixel unit 10 may be constituted by a plurality of pixels 12 arranged in an array of several thousand rows and several thousand columns, as in a general digital camera. Alternatively, the pixel unit 10 may be constituted by a plurality of pixels 12 arranged in one row or one column. Alternatively, the pixel unit 10 may be constituted by one pixel 12.

[0012] A control line 14 extending in a first direction (horizontal direction in FIG. 1 ) may be arranged in each row of the pixel unit 10 configured as a pixel array. Each control line 14 may be connected to at least two pixels 12 aligned in the first direction and used to control these pixels 12. The first direction in which the control lines 14 extend may be understood as the row direction or horizontal direction. Each control line 14 may include a plurality of signal lines for supplying a plurality of types of control signals to the pixels 12.

[0013] Each column of the pixel unit 10 configured as a pixel array may be provided with a data line 16 extending in a second direction (vertical direction in FIG. 1 ) intersecting the first direction. Each data line 16 is connected to at least two pixels 12 aligned in the second direction and may be used to read out signals from these pixels 12. The second direction in which the data lines 16 extend may be understood as a column direction or a vertical direction. Each data line 16 may include a plurality of signal lines for transferring a multi-bit digital signal output from the pixel 12 on a bit-by-bit basis.

[0014] The control lines 14 of each row may be connected to a vertical scanning circuit 40. The vertical scanning circuit 40 may receive a control signal output from the control unit 80, generate control signals for driving the pixels 12, and supply the control signals to the pixels 12 via the control lines 14. The vertical scanning circuit 40 may include logic circuits such as a shift register and / or an address decoder. The vertical scanning circuit 40 may be configured to sequentially select the pixels 12 in the pixel section 10 in units of rows, that is, to vertically scan the pixels 12 in the pixel section 10. Pixel signals of the pixels 12 in the selected row may be supplied to a readout circuit 50 via data lines 16.

[0015] The data lines 16 of each column may be connected to a readout circuit 50. The readout circuit 50 may include a plurality of holding units (not shown) provided corresponding to the respective columns of the pixel unit 10 as a pixel array, and may hold pixel signals of the pixels 12 of a plurality of columns outputted row by row from the pixel unit 10 via the data lines 16 by the holding units of the corresponding columns.

[0016] The horizontal scanning circuit 60 may receive a control signal output from the control unit 80, generate a control signal for reading out pixel signals from the holding units of each column of the readout circuit 50, and supply the control signal to the readout circuit 50. The horizontal scanning circuit 60 may include logic circuits such as a shift register and / or an address decoder. The horizontal scanning circuit 60 may be configured to sequentially select the holding units of multiple columns of the readout circuit 50, that is, to horizontally scan the holding units of multiple columns. The pixel signals held by the holding units of the selected column are supplied to the output circuit 90.

[0017] The output circuit 90 has an external interface circuit and can output the pixel signals output from the readout circuit 50 to the outside of the photoelectric conversion device 100. The external interface circuit included in the output circuit 90 is not particularly limited. The external interface circuit can be configured, for example, by a SerDes (SERializer / DESerializer) transmission circuit. The SerDes transmission circuit is, for example, an LVDS (Low Voltage Differential Signaling) circuit or an SLVS (Scalable Low Voltage Signaling) circuit.

[0018] The control unit 80 can generate control signals that control the operations and timings of the vertical scanning circuit 40, the readout circuit 50, and the horizontal scanning circuit 60. At least some of the control signals that control the operations and timings of the vertical scanning circuit 40, the readout circuit 50, and the horizontal scanning circuit 60 may be supplied from outside the photoelectric conversion device 100.

[0019] The connection manner of each functional block of the photoelectric conversion device 100 is not limited to the configuration example of FIG. 1, and may be configured as illustrated in FIG. 2, for example. In the configuration example of FIG. 2, data lines 16 extending in a first direction are arranged in each row of a pixel section 10 as a pixel array. The data lines 16 are each connected to at least two pixels 12 arranged in the first direction and can be used to control these pixels 12. Control lines 18 extending in a second direction are arranged in each column of the pixel section 10 as a pixel array. The control lines 18 are each connected to at least two pixels 12 arranged in the second direction and can be used to read out signals from these pixels 12.

[0020] The control lines 18 of the multiple columns may be connected to a horizontal scanning circuit 60. The horizontal scanning circuit 60 may receive a control signal output from the control unit 80, generate a control signal for reading out pixel signals from the pixels 12, and supply the control signal to the pixels 12 via the control lines 18. Specifically, the horizontal scanning circuit 60 may be configured to sequentially select the multiple pixels 12 of the pixel unit 10 in units of columns, that is, to horizontally scan the multiple pixels 12 in the pixel unit 10. The pixel signals of the pixels 12 belonging to the selected column may be output to the data lines 16.

[0021] The data lines 16 of each row may be connected to a readout circuit 50. The readout circuit 50 may include a plurality of holding units (not shown) provided corresponding to the respective rows of the pixel section 10 as a pixel array, and may hold pixel signals of the pixels 12 of a plurality of rows outputted in units of columns from the pixel section 10 via the data lines 16 by the holding units of the corresponding rows. Upon receiving a control signal outputted from the control unit 80, the readout circuit 50 may sequentially output the pixel signals held by the holding units of the respective rows to the output circuit 90. Other configurations in the configuration example of FIG. 2 may be similar to those in the configuration example of FIG. 1.

[0022] 3, each pixel 12 may include a photodetection section 20 and a signal processing section 30. The photodetection section 20 may include, for example, a photon detection element 22 and a quenching element 24. The signal processing section 30 may include, for example, a waveform shaping section 32, a processing circuit 34, and a pixel output circuit 36.

[0023] The photon detection element 22 may be, for example, an avalanche photodiode (hereinafter, referred to as "APD"). The anode of the APD constituting the photon detection element 22 may be connected to a node to which a voltage VL is supplied. The cathode of the APD constituting the photon detection element 22 may be connected to one terminal of the quench element 24. The connection node connecting the photon detection element 22 and the quench element 24 may be understood as the output node of the photodetection unit 20. The other terminal of the quench element 24 may be connected to a node to which a voltage VH higher than the voltage VL is supplied. The voltages VL and VH may be set so that a reverse bias voltage sufficient for the APD to perform an avalanche multiplication operation is applied. In one example, a negative high voltage is applied as the voltage VL, and a positive voltage approximately equal to the power supply voltage is applied as the voltage VH. For example, the voltage VL is -30V, and the voltage VH is 1V.

[0024] The photon detection element 22 may be configured by an APD as described above. By supplying the APD with a reverse bias voltage sufficient for avalanche multiplication, the charge generated by the incidence of light on the APD undergoes avalanche multiplication, generating an avalanche multiplication current. There are two operation modes when the APD is supplied with a reverse bias voltage: Geiger mode and linear mode. The Geiger mode is an operation mode in which the voltage applied between the anode and the cathode is a reverse bias voltage greater than the breakdown voltage of the APD. The linear mode is an operation mode in which the voltage applied between the anode and the cathode is a reverse bias voltage close to or less than the breakdown voltage of the APD. An APD operated in the Geiger mode is called a Single Photon Avalanche Diode (SPAD). The APD constituting the photon detection element 22 may be operated in either the linear mode or the Geiger mode.

[0025] The quench element 24 may have a function of converting a change in avalanche multiplication current generated in the photon detection element 22 into a voltage signal. The quench element 24 functions as a load circuit (quench circuit) during signal multiplication by avalanche multiplication, and may have a function of suppressing avalanche multiplication by reducing the voltage applied to the photon detection element 22. The operation of the quench element 24 to suppress avalanche multiplication is called a quench operation. The quench element 24 may also have a function of returning the voltage supplied to the photon detection element 22 to the voltage VH by passing a current equivalent to the voltage drop caused by the quench operation. The operation of returning the voltage supplied to the photon detection element 22 by the quench element 24 to the voltage VH is called a recharge operation. The quench element 24 may be configured of a resistor element, a MOS transistor, or the like.

[0026] The waveform shaping section 32 has an input node to which the output signal of the light detection section 20 is supplied, and an output node. The waveform shaping section 32 can have a function of converting the analog signal supplied from the light detection section 20 into a pulse signal. As illustrated in Fig. 3, the waveform shaping section 32 can be configured with an inverter circuit or the like. The output node of the waveform shaping section 32 can be connected to a processing circuit 34.

[0027] The processing circuit 34 may have an input node to which the output signal of the waveform shaping unit 32 is supplied, an input node connected to the control line 14, and an output node. The processing circuit 34 has a counter, which will be described later. The counter may have a function of counting pulses superimposed on the signal output from the waveform shaping unit 32 and holding a count value that is the result of the counting. The signal supplied from the vertical scanning circuit 40 to the processing circuit 34 via the control line 14 may include a timer clock signal for controlling the pulse count period (exposure period), etc. The output node of the processing circuit 34 may be connected to the data line 16 via the pixel output circuit 36.

[0028] The pixel output circuit 36 ​​may have a function of switching an electrical connection state (connected or unconnected) between the processing circuit 34 and the data line 16. The pixel output circuit 36 ​​may switch the connection state between the processing circuit 34 and the data line 16 in response to a control signal supplied from the vertical scanning circuit 40 via the control line 14 (in the configuration example of FIG. 2, a control signal supplied from the horizontal scanning circuit 60 via the control line 18). The pixel output circuit 36 ​​may include a buffer circuit for outputting a signal.

[0029] The pixel 12 is typically a unit structure that outputs a pixel signal for forming an image. However, in cases where the purpose is distance measurement using a TOF (Time of Flight) method, the pixel 12 does not necessarily have to be a unit structure that outputs a pixel signal for forming an image. In other words, the pixel 12 can also be a unit structure that outputs a signal for measuring the time when light arrives and the amount of light.

[0030] It is not necessary that one signal processing unit 30 is provided for each pixel 12, but one signal processing unit 30 may be provided for multiple pixels 12. In this case, the single signal processing unit 30 can be used to sequentially execute signal processing for the multiple pixels 12.

[0031] The photoelectric conversion device 100 according to the present embodiment may be formed on a single substrate, or may be configured as a stacked photoelectric conversion device in which a plurality of substrates are stacked. In the latter case, for example, as illustrated in FIG. 4, it can be configured as a stacked photoelectric conversion device in which a sensor substrate 110 and a circuit substrate 120 are stacked and electrically connected. At least the photon detection element 22, which is one of the components of the pixel 12, can be arranged on the sensor substrate 110. Furthermore, among the components of the pixel 12, the quench element 24 and the signal processing unit 30 can be arranged on the circuit substrate 120. The photon detection element 22, the quench element 24, and the signal processing unit 30 are electrically connected via connection wiring provided for each pixel 12. Furthermore, the circuit substrate 120 can further include a vertical scanning circuit 40, a readout circuit 50, a horizontal scanning circuit 60, a control unit 80, an output circuit 90, and the like.

[0032] In each pixel 12, the photon detection element 22, the quench element 24, and the signal processing unit 30 may be arranged on the sensor substrate 110 and the circuit substrate 120 so as to overlap in a planar view. The vertical scanning circuit 40, the readout circuit 50, the horizontal scanning circuit 60, the control unit 80, and the output circuit 90 may be arranged around the pixel unit 10 composed of a plurality of pixels 12. In this specification, the term "planar view" refers to a view from a direction perpendicular to the light incident surface of the sensor substrate 110.

[0033] By configuring a stacked photoelectric conversion device 100, it is possible to increase the integration density of elements and achieve high performance. In particular, by arranging the photon detection elements 22, the quench element 24, and the signal processing unit 30 on separate substrates, it is possible to arrange the photon detection elements 22 at high density without sacrificing the light receiving area of ​​the photon detection elements 22, and it is possible to improve the photon detection efficiency. The number of substrates constituting the photoelectric conversion device 100 is not limited to two, and the photoelectric conversion device 100 may be configured by stacking three or more substrates.

[0034] 4, diced chips are assumed as sensor substrate 110 and circuit substrate 120, but sensor substrate 110 and circuit substrate 120 are not limited to chips. For example, sensor substrate 110 and circuit substrate 120 may each be a wafer. Sensor substrate 110 and circuit substrate 120 may be stacked in the wafer state and then diced, or may be stacked and bonded after being formed into chips.

[0035] Fig. 5 is a diagram for explaining the basic operation of the photodetector 20 and the waveform shaping unit 32. Fig. 5(a) is a circuit diagram of the photodetector 20 and the waveform shaping unit 32, Fig. 5(b) shows the waveform of a signal at an input node (node ​​A) of the waveform shaping unit 32, and Fig. 5(c) shows the waveform of a signal at an output node (node ​​B) of the waveform shaping unit 32. Note that, for simplicity of explanation, it is assumed here that the waveform shaping unit 32 is configured with an inverter circuit.

[0036] At time t0, a reverse bias voltage with a potential difference equivalent to (VH-VL) is applied to the photon detection element 22. A reverse bias voltage sufficient to cause avalanche multiplication is applied between the anode and cathode of the APD that constitutes the photon detection element 22. When no photons are incident on the photon detection element 22, there are no carriers that serve as the seed for avalanche multiplication. Therefore, avalanche multiplication does not occur in the photon detection element 22, and no current flows through the photon detection element 22.

[0037] At the next time t1, a photon is assumed to be incident on the photon detection element 22. When a photon is incident on the photon detection element 22, electron-hole pairs are generated by photoelectric conversion, and avalanche multiplication occurs using these carriers as seeds, causing an avalanche multiplication current to flow through the photon detection element 22. This avalanche multiplication current flows through the quench element 24, causing a voltage drop across the quench element 24, and the voltage at node A begins to drop. When the amount of voltage drop at node A becomes large and the avalanche multiplication stops at time t3, the voltage level at node A no longer drops.

[0038] When the avalanche multiplication in the photon detecting element 22 stops, a current that compensates for the voltage drop flows from the node to which the voltage VL is supplied to the node A via the photon detecting element 22, and the voltage of the node A gradually increases. After that, at time t5, the node A settles to the original voltage level.

[0039] The waveform shaping unit 32 binarizes the signal input from node A according to a predetermined judgment threshold and outputs it from node B. Specifically, when the voltage level of node A exceeds the judgment threshold, the waveform shaping unit 32 outputs a low-level signal from node B, and when the voltage level of node A is equal to or lower than the judgment threshold, the waveform shaping unit 32 outputs a high-level signal from node B. For example, as shown in FIG. 5(b), assume that the voltage of node A is equal to or lower than the judgment threshold during the period from time t2 to time t4. In this case, as shown in FIG. 5(c), the signal level at node B is low during the period from time t0 to time t2 and the period from time t4 to time t5, and is high during the period from time t2 to time t4.

[0040] In this way, the analog signal input from node A is shaped into a digital signal by the waveform shaping unit 32. The pulse signal output from the waveform shaping unit 32 in response to a photon being incident on the photon detecting element 22 can be understood as a photon detection pulse signal.

[0041] FIG. 6 is a diagram for explaining the configuration of the pixel 12 in more detail. In the explanation of FIG. 6, the explanation of the parts overlapping with FIG. 3 or FIG. 5 will be omitted or simplified. In this embodiment, the processing circuit 34 includes a counter 342 and a flag signal generating unit 341. The processing circuit 34 may include a waveform shaping unit 32. The counter 342 counts the output of the photon detecting element 22, more specifically, the pulses based on the photons incident on the photon detecting element 22, and may hold a count value that is a result of the counting. In order to hold the count value, the counter 342 may have a multi-bit memory capable of holding a multi-bit digital signal, for example, a plurality of flip-flops. The count value held in the counter 342 is output to the flag signal generating unit 341. The flag signal generating unit 341 may generate a reset signal RES for resetting the counter 342 and a flag signal F in response to the output of the counter 342 reaching a predetermined value (predetermined count value). The counter 342 is reset by the reset signal RES from the flag signal generating unit 341. The flag signal generation unit 341 may be a digital circuit configured to perform arithmetic processing based on the count value, which is a digital signal. The readout circuit 50 may be configured to read out the flag signal F generated from the flag signal generation unit 341 via the pixel output circuit 36.

[0042] FIG. 7 shows a timing chart of the operation of the pixel 12. As described above, the counter 342 counts pulses based on photons incident on the photon detection element 22, and in the example of FIG. 7, the counter 342 counts up. In the example of FIG. 7, the number of bits of the counter 342 is 4, and when the count value of the pulses based on photons incident on the photon detection element 22 reaches 15 (predetermined value), the count value of the counter 342 is saturated. Here, when the count value of the counter 342 reaches 15 (predetermined value), the flag signal generation unit 341 generates (activates) a flag signal F as shown in FIG. 7. When the count value of the counter 342 reaches 15 (predetermined value), the flag signal generation unit 341 also generates a reset signal RES to reset the counter 342. The counter 342 is reset by the set signal RES, and the count value returns to 0.

[0043] In a typical counter, when the count value becomes saturated, the count value returns to 0 in response to the input of the next pulse. In that case, the count will be missed by the amount of the next pulse. Therefore, when the count value of counter 342 reaches 15 (a predetermined value), flag signal generating unit 341 generates a reset signal RES that resets counter 342.

[0044] The readout circuit 50 receives the flag signal F output from the flag signal generation unit 341, and can detect the occurrence of an event based on the flag signal F. Detecting the occurrence of an event means that the amount of light incident on the photon detection element 22 of the pixel 12 satisfies a predetermined condition. This predetermined condition may be, for example, that the difference between the count values ​​of two or more pixels 12 exceeds a predetermined threshold, or that the amount of change in the count values ​​exceeds a predetermined threshold.

[0045] FIG. 8 shows an example of a specific circuit of the counter 342 and the flag signal generating unit 341. The counter 342 may be composed of, for example, a plurality of flip-flops. The flag signal generating unit 341 may be composed of, for example, a flip-flop and a logic circuit (an AND circuit in the example of FIG. 8). When the number of bits of the counter 342 is four, the flag signal generating unit 341 may include a flip-flop arranged to be the fifth bit. Then, in response to the transition of the output of the fifth bit to an active level, the output of the flip-flop of the fifth bit may be connected to the reset terminals of all the flip-flops so that the counter 342 and the flip-flop of the fifth bit are all reset. In the case of the circuit example of FIG. 8, the pulse width of the flag signal F is determined by the output delay of the flip-flop and the reset delay. [Second embodiment] A photoelectric conversion device 100 according to a second embodiment of the present disclosure will be described with reference to Fig. 9. Note that matters not mentioned in the second embodiment may follow the first embodiment. In the second embodiment, the occurrence of an event is detected based on a flag signal F generated according to a count value of pulses based on photons incident on the photon detection element 22.

[0046] FIG. 9 exemplarily illustrates an operation of detecting the occurrence of an event by measuring the time interval between adjacent flag signals F. A pulse of the flag signal F is generated when the count value of the counter 342 reaches a predetermined value. Thus, by measuring the pulse interval between adjacent flag signals F, the interval at which the count value of photons reaches the predetermined value, i.e., the amount of photons incident on the photon detection element 22, can be known. The pulse interval can be measured, for example, as the time from the rising edge of a pulse to the rising edge of the next pulse, as illustrated by the arrow in FIG. 9. Also, the pulse interval can be measured, for example, using a counter that counts a clock signal CLK whose period is sufficiently shorter than the interval between pulse signals. The measurement of the pulse interval, i.e., the detection of the occurrence of an event, can be performed, for example, by the readout circuit 50. The readout circuit 50 can be configured to detect the occurrence of an event, for example, when the pulse interval exceeds a first threshold value or when the change amount of the pulse interval exceeds a second threshold value. [Third embodiment] A photoelectric conversion device 100 according to a third embodiment of the present invention will be described with reference to Fig. 10. Note that matters not mentioned in the third embodiment may follow the first embodiment. In the third embodiment, the occurrence of an event is detected based on a count value (number of occurrences) of a flag signal F generated according to a count value of a pulse based on photons incident on a photon detection element 22.

[0047] FIG. 10 exemplarily illustrates an operation of detecting the occurrence of an event based on the count value of the pulses of the flag signal F in a predetermined period. The pulses of the flag signal F are generated when the count value of the counter 342 reaches a predetermined value. Thus, by counting the number of pulses (the number of occurrences) of the flag signal F (by another counter), the amount of photons incident on the photon detection element 22 can be known. When the number of bits of the counter 342 is four, counting the pulses of the flag signal F is equivalent to counting the number of times the fifth bit becomes active. The readout circuit 50 includes a counter (second counter) that counts the flag signal F, and can be configured to detect the occurrence of an event when the count value by the counter (second counter) exceeds a third threshold value or when the amount of change in the count value exceeds a fourth threshold value. [Fourth embodiment] A photoelectric conversion device 100 according to a fourth embodiment of the present disclosure will be described with reference to Fig. 11 and Fig. 12. Note that matters not mentioned in the fourth embodiment may follow the first embodiment. In the fourth embodiment, the readout circuit 50 not only detects the occurrence of an event, but also reads out pixel signals.

[0048] FIG. 11 illustrates an example of the configuration of the pixel 12 and the configuration of the readout circuit 50. The processing circuit 34 of the pixel 12 includes a counter 342 and a flag signal generation unit 341, as in the first embodiment. The readout circuit 50 includes a pixel readout circuit 51 and an event readout circuit 52. The counter 342 counts the output of the photon detection element 22, more specifically, pulses based on photons incident on the photon detection element 22, and can hold a count value that is a result of the counting. The count value held in the counter 342 is output to the flag signal generation unit 341. The flag signal generation unit 341 can generate a reset signal RES that resets the counter 342 and also generate a flag signal F in response to the output of the counter 342 reaching a predetermined value (predetermined count value). The counter 342 is reset by the reset signal RES from the flag signal generation unit 341. The flag signal generation unit 341 can be a digital circuit configured to be able to perform arithmetic processing based on the count value, which is a digital signal.

[0049] The event readout circuit 52 may be configured to read out the flag signal F generated by the flag signal generation unit 341 via the pixel output circuit 36. The event readout circuit 52 may also be configured to detect the occurrence of an event based on the flag signal F, and output a SEL signal for switching the operation of the counter 342 to the processing circuit 34 in response to the detection of the occurrence of the event. Upon receiving the SEL signal, the processing circuit 34 may transition from a first mode in which the occurrence of an event is monitored to a second mode in which a pixel signal is generated. In the second mode, the count value of the counter 342 for a predetermined period (one frame) is output to the pixel readout circuit 51 via the pixel output circuit 36.

[0050] The configuration of the counter 342 and flag signal generator 341 having the first and second modes will be described with reference to Fig. 12. Fig. 12(a) shows a schematic configuration of the counter 342 and flag signal generator 341 in the first mode for monitoring the occurrence of an event. In the first mode for monitoring the occurrence of an event, if the counter 342 is configured as a 4-bit counter as shown in Fig. 8, a flag signal F is generated by a flip-flop circuit in the subsequent stage. At this time, the flip-flops (flip-flops indicated by dotted lines) constituting the upper 3 bits are disabled.

[0051] 12(b) shows a schematic configuration of the counter 342 and the flag signal generator 341 after an event occurrence is detected and the mode is shifted from the first mode to the second mode. In the second mode, the upper three bits that were disabled in the first mode are enabled, and an eight-bit counter is configured together with a one-bit flip-flop circuit for generating an event flag signal.

[0052] 12(c) shows a schematic configuration of the counter 342 and the flag signal generating unit 341 having a first mode and a second mode. In the first mode, the event readout circuit 52 drives the control signal SEL to logic 0, and in the second mode, the event readout circuit 52 drives the control signal SEL to logic 1. The control signal SEL is supplied to a switching circuit 1201, and when SEL=0 (first mode), the upper three bits are disabled, and when SEL=1 (second mode), the upper three bits are enabled.

[0053] That is, in the first mode in which the occurrence of an event is monitored, the flag signal generation unit 341 generates a flag signal F and resets the counter 342 in response to the count value of the counter 342 reaching a predetermined value. In the second mode in which the flag signal generation unit 341 generates pixel signals, the flag signal generation unit 341 does not reset the counter 342 even if the count value of the counter 342 reaches the predetermined value. In addition, the flag signal generation unit 341 transitions from the first mode to the second mode in response to detection of the occurrence of an event by the readout circuit 50. In the first mode, the counter 342 operates as a counter with a first number of bits, and in the second mode, operates as a counter with a second number of bits that is greater than the first number of bits. [Fifth embodiment] A photoelectric conversion device 100 according to a fifth embodiment of the present disclosure will be described with reference to Fig. 13. Note that matters not mentioned in the fifth embodiment may follow the first and fourth embodiments. As illustrated in Fig. 13(a), the photoelectric conversion device 100 may include a pixel unit 10, a vertical scanning circuit 40, a pixel readout circuit 51, and an event readout circuit 52.

[0054] The pixel readout circuit 51 can read out pixel signals from each pixel 12 in the pixel section 10. The event readout circuit 52 can be configured to read out flag signals from multiple pixels 12 in the pixel section 10. Here, the multiple pixels 12 in the pixel section 10 can be divided into multiple groups, and each group can be provided with a signal line TL that transmits a signal corresponding to the output of each flag signal generation unit 341 of at least two pixels 12 constituting the group.

[0055] FIG. 13(b) shows an example in which each group is composed of pixels 12 in one column. Specifically, a signal synthesized from the outputs of the flag signal generating units 341 of at least two pixels 12 constituting a column as a group is read by the event readout circuit 52 via a signal line TL. With this configuration, the vertical scanning circuit 40 does not need to be supported to read the flag signal. Also, with this configuration, the configuration required to read the flag signal is simplified, and the overall circuit scale can be reduced. In the example of FIG. 13, each group is composed of pixels 12 in one column, but for example, each group may be composed of pixels 12 in one row. [Sixth embodiment] A photoelectric conversion device 100 according to a sixth embodiment of the present disclosure will be described with reference to Fig. 14. Note that matters not mentioned as the fifth embodiment may follow the first and fourth embodiments. As illustrated in Fig. 14(a), the photoelectric conversion device 100 may include a pixel unit 10, a vertical scanning circuit 40, a pixel readout circuit 51, and an event readout circuit 52.

[0056] The pixel readout circuit 51 can read out pixel signals from each pixel 12 in the pixel section 10. The event readout circuit 52 can be configured to read out flag signals from multiple pixels 12 in the pixel section 10. Here, the multiple pixels 12 in the pixel section 10 can be divided into multiple groups, and each group can be provided with a signal line TL that transmits a signal corresponding to the output of each flag signal generation unit 341 of at least two pixels 12 constituting the group.

[0057] FIG. 14(b) shows an example in which each group is composed of 2×2 pixels 12. In other words, FIG. 14(b) shows an example in which each group is composed of a two-dimensional area composed of pixels arranged in at least two rows and at least two different columns. Specifically, a signal synthesized from the output of each flag signal generating unit 341 of at least four pixels 12 in the two-dimensional area as a group is read by the event readout circuit 52 via a signal line TL. With this configuration, the assistance of the vertical scanning circuit 40 is not required to read out the flag signal. Furthermore, with this configuration, the configuration required for reading out the flag signal is simplified, and the overall circuit scale can be reduced.

[0058] Hereinafter, a photoelectric conversion system incorporating the photoelectric conversion device exemplarily described through each of the above embodiments will be exemplarily described. FIG. 15 shows an example of a photoelectric conversion system. The photoelectric conversion device described in each of the above embodiments is applicable to various photoelectric conversion systems. Examples of applicable photoelectric conversion systems include digital still cameras, digital camcorders, surveillance cameras, copiers, fax machines, mobile phones, vehicle-mounted cameras, and observation satellites. In addition, a camera module having an optical system such as a lens and an imaging device is also included in the photoelectric conversion system.

[0059] The photoelectric conversion system is configured as, for example, an imaging system SYS. The imaging system SYS is an information terminal having a camera or a photographing function. The imaging device IS may further include a package PKG that houses the photoelectric conversion device 100 configured as an imaging device IC. The package PKG may include a base to which the imaging device IC is fixed, a lid body facing the imaging device IC, and a connecting member that connects a terminal provided on the base to a terminal provided on the imaging device IC. The imaging device IS may also mount a plurality of imaging device ICs side by side in a common package PKG. Also, the imaging device IS may also mount the imaging device IC and other semiconductor device ICs in a stacked manner in a common package PKG.

[0060] The imaging system SYS may include an optical system OU that forms an image on the imaging device IS. The imaging system SYS may also include at least one of a control device CU that controls the imaging device IS, a processing device PU that processes signals obtained from the imaging device IS, and a display device DU that displays an image obtained from the imaging device IS. The imaging system SYS may also include a storage device MU that stores the image obtained from the imaging device IS.

[0061] FIG. 16(a) illustrates an example of the configuration of a photoelectric conversion system applied to an in-vehicle camera. The photoelectric conversion system 2300 may include a photoelectric conversion device 100 configured as an imaging device 2310. The photoelectric conversion system 2300 includes an image processing unit 2312 that performs image processing on a plurality of image data acquired by the imaging device 2310, and a parallax acquisition unit 2314 that calculates parallax (phase difference of parallax images) from a plurality of image data acquired by the photoelectric conversion system 2300. The photoelectric conversion system 2300 also includes a distance acquisition unit 2316 that calculates a distance to an object based on the calculated parallax, and a collision determination unit 2318 that determines whether or not there is a possibility of a collision based on the calculated distance. Here, the parallax acquisition unit 2314 and the distance acquisition unit 2316 are examples of distance information acquisition means that acquire distance information to an object. That is, the distance information is information related to the parallax, the defocus amount, the distance to the object, and the like. The collision determination unit 2318 may determine the possibility of a collision using any of these distance information. The distance information acquisition means may be realized by dedicated hardware, a software module, a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), or a combination of these.

[0062] The photoelectric conversion system 2300 is connected to a vehicle information acquisition device 2320, and can acquire vehicle information such as vehicle speed, yaw rate, and steering angle. The photoelectric conversion system 2300 is also connected to a control ECU 2330, which is a control unit that outputs a control signal to generate a braking force for the vehicle based on the judgment result of the collision judgment unit 2318. The photoelectric conversion system 2300 is also connected to an alarm device 2340 that issues an alarm to the driver based on the judgment result of the collision judgment unit 2318. For example, when the judgment result of the collision judgment unit 2318 indicates that there is a high possibility of a collision, the control ECU 2330 performs vehicle control to avoid a collision and reduce damage by applying the brakes, releasing the accelerator, suppressing engine output, etc. The alarm device 2340 warns the user by sounding an alarm, displaying alarm information on a screen of a car navigation system, etc., vibrating a seat belt or steering wheel, etc. In this embodiment, the photoelectric conversion system 2300 captures an image of the surroundings of the vehicle, for example, the front or rear.

[0063] 16(b) shows a photoelectric conversion system configured to capture an image of the area ahead of the vehicle (imaging range 2350). A vehicle information acquisition device 2320 sends an instruction to the photoelectric conversion system 2300 or the imaging device 2310. With this configuration, the accuracy of distance measurement can be further improved.

[0064] Although the above describes an example of control to prevent collision with other vehicles, the present invention can also be applied to control of automatic driving by following other vehicles, control of automatic driving to prevent deviation from lanes, etc. Furthermore, the photoelectric conversion system is not limited to vehicles such as the vehicle itself, but can be applied to moving bodies (moving devices) such as ships, aircraft, and industrial robots. In addition, the present invention can be applied not only to moving bodies, but also to a wide range of devices that use object recognition, such as intelligent transport systems (ITS).

[0065] 17 illustrates an example of the configuration of a photoelectric conversion system configured as a range image sensor. The range image sensor 400 includes an optical system 407, a photoelectric conversion device 408, an image processing circuit 404, a monitor 405, and a memory 406. The range image sensor 400 can obtain a range image according to the distance to the subject by receiving light (modulated light or pulsed light) projected from a light source device 409 toward the subject and reflected by the surface of the subject.

[0066] The optical system 407 is configured with one or more lenses, and guides image light (incident light) from a subject to a photoelectric conversion device 408, and forms an image on a light receiving surface (sensor unit) of the photoelectric conversion device 408. As the photoelectric conversion device 408, the photoelectric conversion device of each of the above-mentioned embodiments is applied, and a distance signal indicating a distance determined from a light receiving signal output from the photoelectric conversion device 408 is supplied to the image processing circuit 404.

[0067] The image processing circuit 404 performs image processing to construct a distance image based on the distance signal supplied from the photoelectric conversion device 408. The distance image (image data) obtained by the image processing is then supplied to a monitor 405 for display, or supplied to a memory 406 for storage (recording). In the distance image sensor 400 configured in this way, by applying the above-mentioned photoelectric conversion device, it is possible to obtain, for example, a more accurate distance image as the pixel characteristics improve.

[0068] The present disclosure includes disclosure of the following devices and systems: (Item 1) a light detection unit including a photon detection element; A counter that counts the output of the light detection unit; a flag signal generating unit that resets the counter and generates a flag signal in response to a count value of the counter reaching a predetermined value; A photoelectric conversion device comprising: (Item 2) A read circuit for processing the flag signal is further provided. The read circuit detects the occurrence of an event based on the flag signal. 2. The photoelectric conversion device according to item 1, (Item 3) the read circuit detects the occurrence of an event based on a time interval of the flag signal. 3. The photoelectric conversion device according to item 2, (Item 4) the readout circuit detects the occurrence of an event according to the number of occurrences of the flag signal within a predetermined period of time. 3. The photoelectric conversion device according to item 2, (Item 5) the flag signal generation unit, in a first mode for monitoring occurrence of an event, resets the counter and generates the flag signal in response to a count value of the counter reaching the predetermined value, and in a second mode for generating a pixel signal, does not reset the counter even when the count value of the counter reaches the predetermined value; the flag signal generation unit transitions from the first mode to the second mode in response to detection of an occurrence of an event by the readout circuit; 5. The photoelectric conversion device according to any one of items 2 to 4, (Item 6) The counter operates as a counter of a first number of bits in the first mode, and operates as a counter of a second number of bits, which is greater than the first number of bits, in the second mode. 6. The photoelectric conversion device according to item 5, (Item 7) a plurality of pixels, each pixel including the counter and the flag signal generating unit; 7. The photoelectric conversion device according to any one of items 2 to 6, (Item 8) The plurality of pixels are divided into a plurality of groups, and each group is provided with a signal line for transmitting a signal corresponding to an output of the flag signal generating unit of at least two pixels constituting the group. 8. The photoelectric conversion device according to item 7, (Item 9) a read circuit for reading out a signal transmitted through each of the signal lines of the plurality of groups; 9. The photoelectric conversion device according to item 8, (Item 10) Each group is one row, 10. The photoelectric conversion device according to item 8 or 9, (Item 11) Each group is one column, 10. The photoelectric conversion device according to item 8 or 9, (Item 12) Each group is a two-dimensional region of pixels arranged in at least two rows and at least two columns. 10. The photoelectric conversion device according to item 8 or 9, (Item 13) The photon detection element is an avalanche photodiode. 13. The photoelectric conversion device according to any one of items 1 to 12, (Item 14) The photoelectric conversion device according to any one of items 1 to 13, and a signal processing unit that processes a signal output from the photoelectric conversion device.

[0069] The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0070] 12: pixel, 20: light detection unit, 34: processing circuit, 341: flag signal generation unit, 342: counter, 100: photoelectric conversion device

Claims

1. a light detection unit including a photon detection element; A counter that counts the output of the light detection unit; a flag signal generating unit that resets the counter and generates a flag signal in response to a count value of the counter reaching a predetermined value; A photoelectric conversion device comprising:

2. A read circuit for processing the flag signal is further provided. The read circuit detects the occurrence of an event based on the flag signal.

2. The photoelectric conversion device according to claim 1.

3. the read circuit detects the occurrence of an event based on a time interval of the flag signal.

3. The photoelectric conversion device according to claim 2.

4. the readout circuit detects the occurrence of an event according to the number of occurrences of the flag signal within a predetermined period of time.

3. The photoelectric conversion device according to claim 2.

5. the flag signal generation unit, in a first mode for monitoring occurrence of an event, resets the counter and generates the flag signal in response to the count value of the counter reaching the predetermined value, and in a second mode for generating a pixel signal, does not reset the counter even when the count value of the counter reaches the predetermined value; the flag signal generation unit transitions from the first mode to the second mode in response to detection of an occurrence of an event by the readout circuit; 3. The photoelectric conversion device according to claim 2.

6. The counter operates as a counter of a first number of bits in the first mode, and operates as a counter of a second number of bits, the second number of bits being greater than the first number of bits, in the second mode.

6. The photoelectric conversion device according to claim 5.

7. a plurality of pixels, each pixel including the counter and the flag signal generating unit; 3. The photoelectric conversion device according to claim 2.

8. the plurality of pixels are divided into a plurality of groups, and each group is provided with a signal line for transmitting a signal corresponding to an output of the flag signal generating unit of at least two pixels constituting the group; 8. The photoelectric conversion device according to claim 7.

9. a read circuit for reading out a signal transmitted through each of the signal lines of the plurality of groups; 9. The photoelectric conversion device according to claim 8.

10. Each group is one row, 9. The photoelectric conversion device according to claim 8.

11. Each group is a column.

9. The photoelectric conversion device according to claim 8.

12. Each group is a two-dimensional region of pixels arranged in at least two rows and at least two columns.

9. The photoelectric conversion device according to claim 8.

13. The photon detection element is an avalanche photodiode.

2. The photoelectric conversion device according to claim 1.

14. The photoelectric conversion device according to any one of claims 1 to 13, and a signal processing unit that processes a signal output from the photoelectric conversion device.

Citation Information

Patent Citations

  • Solid-state image sensor, imaging device, and control method of solid-state image sensor

    JP2020096347A

  • Photoelectric conversion device, imaging system, and moving body

    JP2020123847A