Image sensor based on single photon avalanche diode and driving method thereof
By estimating the total number of photons in a single-photon avalanche diode image sensor using the overflow time point of the counter, the increase in power consumption caused by multi-bit counters is solved, and a significant reduction in power consumption is achieved.
Patent Information
- Application Number
- CN202280099938.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-09-27
- Filing Date
- 2022-10-25
- Publication Date
- 2025-04-08
AI Technical Summary
When using a single-photon avalanche diode for image sensing, a multi-bit counter is used to count multiple photons to cause the circuit size to increase and the power consumption to increase.
The total pulse (i.e., total photons) is estimated by using the overflow time point of the counter, and only a portion of the photons are counted, thereby reducing power consumption.
The power consumed by the counter is significantly reduced, only a portion of all photons received by the image sensor is counted, and the total number of photons is estimated to reduce power consumption.
Smart Images

Figure CN119790663A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to an image sensor based on a single photon avalanche diode and a driving method thereof.
[0002] This invention is derived from the research conducted as part of the government-other government agencies-inter-department-inter-departmental full-cycle medical device research and development project-inter-departmental full-cycle medical device research and development project (Project unique number: 1711138024, detailed project number: RS-2020-KD000048, research project name: Development of 20x20cm large-area hybrid X-ray video detector based on Global Shutter (Phase 2 / 2) (1 / 2), competent authority: Rayence Co., Ltd., research period: March 1, 2022 to December 31, 2022) of the inter-departmental full-cycle medical device research and development project. On the other hand, the Korean government has no property benefits in any aspect of this invention. Background Art
[0003] Single-Photon Avalanche Diode (SPAD) is a sensor technology that detects weak light signals at the photon level. In particular, since SPAD uses the avalanche multiplication effect to amplify incident single photons, it has very high sensitivity and is very easy to capture even in dark environments.
[0004] On the other hand, it is necessary to count the trigger pulses generated by photons in such a single-photon avalanche diode. However, when a multi-bit counter is used to count multiple photons, the circuit scale increases, resulting in a problem of increased power consumption. Summary of the invention
[0005] Technical problems to be solved
[0006] In the present disclosure, in order to solve the above problems, an image sensor based on a single-photon avalanche diode is provided, which reduces power consumption by estimating the total number of pulses (ie, total photons) using the overflow time point of a counter.
[0007] Technical means of solving problems
[0008] According to an embodiment of the present disclosure, an image sensor based on a single photon avalanche diode may include: a single photon avalanche diode (SPAD) generating a plurality of pulses corresponding to each of a plurality of photons received during a predetermined exposure time; a front-end circuit receiving a pulse group received during a portion of the exposure time among the plurality of pulses; and a counter counting the number of pulses in the pulse group. The end point of the portion of the time is based on an overflow time point of the counter counting the number of pulses in the pulse group.
[0009] According to an embodiment, the counter may count the number of a plurality of clock pulses obtained by the front-end circuit during the exposure time after the overflow time point.
[0010] According to an embodiment, respective time points of the plurality of clock pulses relative to the exposure time may be configured to have at least one shape of a logarithmic (log) function, a linear (linear) function, or a square-root (square-root) function.
[0011] According to an embodiment, the single photon avalanche diode based image sensor may further include a global clock for providing a plurality of clock pulses to the front-end circuit starting from the overflow time point.
[0012] According to an embodiment, the number of total clock pulses generated by the global clock during the exposure time may be the same as the number of pulses in the pulse group received during the partial time.
[0013] According to one embodiment, an image sensor based on a single-photon avalanche diode may further include a processor, which uses a first clock pulse and a second clock pulse to calculate the total number of multiple photons received by the single-photon avalanche diode during an exposure time, wherein the first clock pulse is generated by a global clock before an overflow time point, and the second clock pulse is generated by a global clock after the overflow time point.
[0014] According to one embodiment, the processor may calculate the total using a lookup table associated with the global clock.
[0015] According to one embodiment, the counter of the single-photon avalanche diode-based image sensor may include an N-bit counter, a value of one bit among the N bits is related to an overflow time point, and the remaining bits except the one bit among the N bits are related to values of counting multiple pulses.
[0016] According to another embodiment of the present disclosure, a method for driving an image sensor based on a single-photon avalanche diode may include: a step of receiving a plurality of photons during at least a portion of a predetermined exposure time through a single-photon avalanche diode; a step of generating a plurality of pulses corresponding to each of the plurality of photons through a single-photon avalanche diode; a step of receiving the plurality of pulses through a front-end circuit; and a step of counting the plurality of pulses through a counter. The end point of at least a portion of the time is configured as an overflow time point based on a counter that counts the plurality of pulses.
[0017] According to another embodiment of the present disclosure, a computer-readable non-transitory storage medium storing a program for executing a single-photon avalanche diode-based image sensor driving method may be provided.
[0018] Effects of the Invention
[0019] According to some embodiments of the present disclosure, only a portion of all photons received by a single-photon avalanche diode may be counted, and the overflow time point of the counter may be used to estimate the total number of photons, thereby significantly reducing the power consumed by the counter. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] Figure 1 is a block diagram showing the structure of an image sensor based on a single photon avalanche diode according to an embodiment of the present disclosure;
[0021] Figure 2 is a diagram for explaining a method for calculating the total number of photons received by an image sensor based on a single photon avalanche diode according to an embodiment of the present disclosure;
[0022] Figure 3 : is a diagram showing clock pulses of a global clock set for providing clock pulses to a front-end circuit according to an embodiment of the present disclosure. DETAILED DESCRIPTION
[0023] Hereinafter, the specific contents of implementing the present disclosure will be described in detail with reference to the accompanying drawings. However, in the following description, if there is a possibility that the gist of the present disclosure may be unnecessarily obscured, the specific description of the well-known functions or structures will be omitted.
[0024] In the accompanying drawings, the same reference numerals are given to the same or corresponding components. In addition, in the description of the following embodiments, repeated descriptions of the same or corresponding components may be omitted. However, even if the description of the components is omitted, it does not mean that such components are not included in a certain embodiment.
[0025] The advantages, features and methods of implementing the embodiments of the present disclosure will become clear if reference is made to the accompanying drawings and the embodiments described below. However, the present disclosure is not limited to the embodiments disclosed below and can be implemented in a variety of different forms. This embodiment is intended to make the present disclosure complete and to fully reveal the scope of the invention to those skilled in the art.
[0026] Before describing the embodiments of the present disclosure in detail, a brief description of the terms used in this specification is given. The terms used in this specification are all common terms that are currently widely used, and are selected as much as possible after considering the functions of the present disclosure. However, the terms may change due to the intentions of technicians in the field or precedents, the emergence of new technologies, etc. In addition, in certain cases, there are also terms selected by the applicant, and their meanings will be explained in detail in the corresponding specific embodiments. Therefore, the terms used in this disclosure should be defined based on their connotations and the full text of the disclosure, rather than simply based on the names of the terms.
[0027] In this specification, for expressions in singular form, unless the context clearly indicates the singular, the plural meaning is included. In addition, for expressions in plural form, unless the context clearly indicates the plural, the singular meaning is included. In the entire specification, when a part is said to "include" a certain constituent element, unless there is a special record to the contrary, the expression means that other constituent elements may be further included, rather than excluding other constituent elements.
[0028] Figure 1 is a block diagram showing the structure of an image sensor 100 based on a single-photon avalanche diode according to an embodiment of the present disclosure. In simple terms, the image sensor 100 can generate an image in the following manner, namely, receiving multiple photons (Photon) from the outside and counting the number of the received multiple photons (Photon). At this time, the image sensor 100 can consume a considerable amount of power to count (multiple) photons. To this end, in the present disclosure, an image sensor 100 is provided, which only counts a predetermined number of photons and uses information related to the time point when the count ends to estimate the total number of photons received to reduce power consumption. As shown in the figure, the image sensor 100 may include at least one of a single-photon avalanche diode 110, a front-end circuit 120, and a counter 130.
[0029] The single-photon avalanche diode 110 may receive multiple photons from the outside and generate multiple pulses corresponding to each of the received multiple photons. For example, when the single-photon avalanche diode 110 receives N (where N is a natural number) photons, the single-photon avalanche diode 110 may generate N pulses. Then, the generated multiple pulses may be transmitted to the front-end circuit.
[0030] The single-photon avalanche diode 110 can receive a plurality of photons from the outside during a predetermined exposure time and generate a plurality of pulses corresponding to each of the received plurality of photons. For example, when the single-photon avalanche diode 110 receives N (where N is a natural number) photons from 0 [ms] to 16 [ms], the single-photon avalanche diode 110 can generate N pulses. Then, at least a part of the generated plurality of pulses can be transmitted to the front-end circuit.
[0031] The front-end circuit 120 can receive the plurality of pulses generated by the single-photon avalanche diode 110. In this case, the plurality of pulses can refer to the plurality of pulses generated by the single-photon avalanche diode 110 during the exposure time. For example, when the single-photon avalanche diode 110 receives N (where N is a natural number) photons from 0 [ms] to 16 [ms], the front-end circuit 120 can receive N pulses from the single-photon avalanche diode 110. Additionally or alternatively, the front-end circuit 120 can receive at least a part of the plurality of pulses generated by the single-photon avalanche diode 110. For example, when the single-photon avalanche diode 110 receives N (where N is a natural number) photons from 0 [ms] to 16 [ms], the front-end circuit 120 can receive N pulses generated from 0 [ms] to T OF [ms] (where T OF <16) generated N OF ones (where N OF <N) pulses. Another example is that when the single-photon avalanche diode 110 receives N (where N is a natural number) photons from 0 [ms] to 16 [ms], the front-end circuit 120 can receive N pulses generated from T OF1 [ms] to T OF2 [ms] (where 0 < T OF1 <T OF2 <= 16) generated N OF ones (where N OF <N) pulses.
[0032] The front-end circuit 120 can receive a plurality of clock pulses generated by an external device (such as a global clock). In this case, the plurality of clock pulses can refer to the plurality of clock pulses generated during the exposure time. For example, the front-end circuit 120 can receive M clock pulses from 0 [ms] to 16 [ms]. Additionally or alternatively, the front-end circuit 120 can receive the plurality of clock pulses generated during a partial time period of the entire exposure time. Another example is that the front-end circuit 120 can receive the clock pulses generated from T OF [ms] after to 16 [ms] during the exposure time from 0 [ms] to 16 [ms]. For example, the front-end circuit 120 can receive the clock pulses from 0 [ms] to T OF[ms] between the generated clock pulses.
[0033] The front-end circuit 120 may start receiving a plurality of clock pulses generated by an external device in response to a signal received from the counter 130. In this case, the signal received from the counter 130 may refer to a signal generated in response to an overflow of the counter 130. More specifically, the signal received from the counter 130 may refer to a signal transmitted to the front-end circuit 120 in response to an overflow of the counter 130, wherein the counter 130 counts a plurality of pulses received from the single-photon avalanche diode 110 through the front-end circuit 120. For example, when the exposure time is 0 [ms] to 16 [ms], the N-bit counter 130 may start from 0 [ms] and use N-1 bits to count the 2 pulses received from the single-photon avalanche diode 110 through the front-end circuit 120. (N-1) In this case, the value indicating the overflow is input to the remaining 1 bit (bit) not used for counting in the N bits (bit) of the counter 130, and the counter 130 can respond to this by counting at T OF [ms] transmits the signal to the front-end circuit 120. Then, the front-end circuit 120 may stop receiving pulses from the single-photon avalanche diode 110 in response to the signal received from the counter 130, and start receiving clock pulses from the external device. That is, the front-end circuit 120 may transmit the signal to the front-end circuit 120 from 0 [ms] to T OF [ms] ago, multiple pulses are received from the single photon avalanche diode 110 and can be OF [ms] to 16 [ms] after which multiple clock pulses are received from the external device.
[0034] The counter 130 may count the number of pulses input to the front-end circuit 120. For example, the counter 130 may count the number of pulses from 0 [ms] to T OF The counter 130 counts the number of pulses of the plurality of pulses input from the single photon avalanche diode 110 to the front-end circuit 120 before [ms]. As an additional or alternative example, the counter 130 may count the number of pulses of the plurality of pulses input from the single photon avalanche diode 110 to the front-end circuit 120 before [ms]. OF The number of multiple clock pulses input to the front-end circuit 120 from [ms] to 16 [ms] is counted.
[0035] On the other hand, although Figure 1 , but the image sensor 100 may further include a global clock (not shown) for generating the above clock pulses. In this case, the total number of clock pulses generated by the global clock during the exposure time may be equal to the number of N-bit counter 130 (at this time, only N-1 bits of the counter 130 are used for counting) overflowing (i.e., T in the above example). OFThat is, when the N-bit counter 130 is used, the total number of clock pulses generated by the global clock during the exposure time can be pre-set to 2. (N-1) This will be described in detail in Figure 3 To be described later.
[0036] In addition, Figure 1 In the figure, for the sake of convenience, the image sensor 100 is shown as including one single photon avalanche diode 110, but is not limited thereto. That is, the image sensor 100 may include multiple single photon avalanche diodes. For example, the front-end circuit 120 may be connected to multiple single photon avalanche diodes of each pixel configured in the multiple pixels.
[0037] Figure 2 200 is a diagram for explaining a method for calculating the total number of photons received by an image sensor (e.g., image sensor 100) based on a single-photon avalanche diode according to an embodiment of the present disclosure. Here, a counter (e.g., counter 130) provided for counting pulses generated by a single-photon avalanche diode (e.g., single-photon avalanche diode 110) and / or a global clock is composed of N bits, and it is assumed that only N-1 bits are used for counting. In addition, Figure 2 T OF Indicates the time point at which the counter overflows as a result of counting a number of pulses received from the single-photon avalanche diode.
[0038] like Figure 1 As shown in the figure, the counter only counts from 0 to T OF The time period between the single photon avalanche diode generated 2 (N -1) In this case, since the image sensor is exposed to the light source for a time T EXP has a predetermined value, so the total number of photons N received by the image sensor during the exposure time can be calculated according to the following mathematical formula 1 PH In this case, you can save PH / N OF The corresponding amount of power to count photons. N OF It refers to the number of photons received by the image sensor from the time when the image sensor is exposed to the light source to the time when the counter overflows. On the other hand, in order to calculate the total number of photons N using mathematical formula 1 PH First, we need to know T, which represents the time point when the counter overflows. OF . Estimated T OF The method is Figure 3 The following will be described later.
[0039]
Mathematical formula 1
[0040]
[0041] Figure 3 300 is a diagram showing clock pulses of a global clock provided for providing clock pulses to a front-end circuit according to an embodiment of the present disclosure. Similarly, a counter (e.g., counter 130) provided for counting pulses generated by a single-photon avalanche diode (e.g., single-photon avalanche diode 110) and / or a global clock is composed of N bits, and it is assumed that only N-1 bits are used for counting. In addition, T OF and T EXP and Figure 2 T OF and T EXP Similarly, they represent the counter overflow time point and the time when the single photon avalanche diode is exposed to the light source, respectively.
[0042] like Figure 1 As shown, the total number of clock pulses M generated during the exposure time is set to be the same as 0 to T OF The number of multiple pulses generated by the single-photon avalanche diode between (N-1) In addition, the timing of each of the clock pulses is set to have at least one of a logarithmic function, a linear function, or a square-root function relative to the exposure time. For example, from 0 to T OF The clock pulse is provided in the form of a linear function between T OF to T EXP The clock pulses are provided in the form of a logarithmic function. That is, the time points of all the clock pulses have predetermined values based on the selected function shape. Therefore, it is possible to OF The serial number of the first clock pulse generated afterwards (here, n+1) and the time point T n+1 To calculate T OF The time point T of the latest clock pulse generated before n At this time, since the overflow of the counter occurs at T n and T n+1 The time points between PH It can be estimated as N OF *(T EXP / T n ) and N OF *(T EXP / T n+1 ), as shown in the following mathematical formula 2.
[0043]
Mathematical formula 2
[0044]
[0045] The foregoing description of the present disclosure is provided to enable a person of ordinary skill to perform or use the present disclosure. Various modifications of the present disclosure are easy and self-explanatory for a person of ordinary skill, and the general principles defined in the present application can be applied to various modifications without exceeding the subject matter or scope of the present disclosure. Therefore, the purpose of the present disclosure is not to be limited to the examples described in the present application, but to give the widest scope consistent with the principles and new features disclosed in the present application.
[0046] Although the present disclosure is described in connection with some embodiments in this specification, it should be understood that various modifications and changes can be made within the scope of the present disclosure as understood by a person of ordinary skill in the art to which the present invention belongs. In addition, such modifications and changes should be considered to fall within the scope of the claims attached to this specification.
Claims
1. An image sensor based on a single photon avalanche diode, comprising: a single photon avalanche diode that generates a plurality of pulses corresponding to respective ones of a plurality of photons received during a predetermined exposure time, a front-end circuit that receives a group of pulses among the plurality of pulses received during a portion of the exposure time, and A counter, for counting the number of pulses in the pulse group; The end point of the partial time is based on an overflow time point of the counter that counts the number of pulses in the pulse group.
2. The single photon avalanche diode based image sensor according to claim 1, wherein: The counter counts the number of a plurality of clock pulses obtained by the front-end circuit during the exposure time after the overflow time point.
3. The single photon avalanche diode based image sensor according to claim 2, wherein: The respective time points of the plurality of clock pulses relative to the exposure time are configured to have at least one shape of a logarithmic function, a linear function, or a square root function.
4. The single photon avalanche diode based image sensor according to claim 1, wherein: Also included is a global clock that provides a plurality of clock pulses to the front-end circuit starting after the overflow time point.
5. The single photon avalanche diode based image sensor according to claim 4, wherein: The number of total clock pulses generated by the global clock during the exposure time is the same as the number of pulses in the pulse group received during the partial time.
6. The single photon avalanche diode based image sensor according to claim 4, wherein: It also includes a processor, which uses a first clock pulse and a second clock pulse to calculate the total number of multiple photons received by the single-photon avalanche diode during the exposure time, wherein the first clock pulse is generated by the global clock before the overflow time point, and the second clock pulse is generated by the global clock after the overflow time point.
7. The single photon avalanche diode based image sensor according to claim 6, wherein: The processor calculates the total using a lookup table associated with the global clock.
8. The single photon avalanche diode based image sensor according to claim 1, wherein: The counter comprises an N-bit counter, The value of one bit in the N bits is related to the overflow time point, The remaining bits of the N bits except the one bit are related to the value of the plurality of pulse counts.
9. A method for driving an image sensor based on a single photon avalanche diode, comprising: The step of receiving a plurality of photons during at least a portion of a predetermined exposure time by a single photon avalanche diode; generating, by the single photon avalanche diode, a plurality of pulses corresponding to each of the plurality of photons; The step of receiving the plurality of pulses by a front end circuit; The step of counting the plurality of pulses by a counter, The end point of the at least a portion of time is configured to be based on an overflow time point of the counter that counts the plurality of pulses. 10 . A computer-readable non-transitory storage medium storing a program for executing the image sensor driving method based on a single photon avalanche diode according to claim 9 .