Photovoltaic device, imaging apparatus, control method, and computer program
Patent Information
- Application Number
- JP2021155380
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2021-09-24
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2041-09-24
AI Technical Summary
【0007】 本発明は、回路規模の増大を抑制しつつ好適に画素読出処理を行う技術を提供する。
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a photoelectric conversion device, an imaging device, a control method, a computer program, etc. that include a photoelectric conversion unit that outputs a signal corresponding to incident photons.
Background Art
[0002] In recent years, a photoelectric conversion device has been proposed that digitally counts the number of photons incident on an avalanche photodiode and outputs the counted value from a pixel as a digitally converted signal.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] In Patent Document 1, a structure is proposed that includes a photon counter for counting photons and a time counter for measuring time. The time counter measures the time from when the measurement of the photon counter starts until the number of photons reaches a predetermined value, and calculates a pixel value from the measured time. However, in Patent Document 1, since a photon counter and a time counter are provided for each pixel, the circuit scale increases.
[0005] The present invention has been made in view of such problems, and an object thereof is to provide a technique for suitably performing pixel readout processing while suppressing an increase in circuit scale.
Means for Solving the Problems
[0006] The present invention, which solves the above problems, is a photoelectric converter having a pixel equipped with a photoelectric conversion unit that outputs a signal in accordance with incident photons, comprising: a first measuring means for measuring the number of photons incident on the pixel; a second measuring means for measuring the time from when the first measuring means starts measuring until the measured value of the first measuring means reaches a first threshold; a selection means for switching the first measuring means connected to the second measuring means from among a plurality of the first measuring means; and a control means for controlling the timing of switching the connection of the second measuring means by the selection means. [Effects of the Invention]
[0007] The present invention provides a technology for suitably performing pixel readout processing while suppressing an increase in circuit size. [Brief explanation of the drawing]
[0008] [Figure 1] Diagram showing an example of the hardware configuration of a photoelectric converter. [Figure 2] A diagram showing an example of a sensor chip for a photoelectric converter. [Figure 3] A diagram showing an example of a circuit chip for a photoelectric converter. [Figure 4a] A diagram showing an example of an equivalent circuit for pixels and signal processing units in a photoelectric converter. [Figure 4b] A diagram showing an example of an equivalent circuit for pixels and signal processing units in a photoelectric converter. [Figure 5] A diagram showing an example of measurement using a photoelectric converter. [Figure 6] Block diagram showing an example of the functional configuration of an imaging device including a photoelectric converter. [Figure 7] A flowchart illustrating an example of the operation of a photoelectric converter. [Modes for carrying out the invention]
[0009] The embodiments for carrying out the present invention will be described in detail below. The embodiments described below are merely examples for realizing the present invention and should be modified or changed as appropriate depending on the configuration of the apparatus to which the present invention is applied and various conditions. The present invention is not limited to the embodiments described below. Furthermore, in all figures, elements with the same function are given the same number, and repeated explanations are omitted.
[0010] <Embodiment 1: Basic Form> Figure 1 shows an example of the configuration of the photoelectric converter according to this embodiment. The photoelectric converter 100 is composed of two chips, a sensor chip 11 and a circuit chip 21, which are stacked and electrically connected. The sensor chip 11 includes a pixel area 12. The circuit chip 21 includes a pixel circuit area 22 that processes signals detected by each pixel of the pixel area 12 in parallel, and a peripheral circuit area 23 that reads signals from the pixel circuit area 22 and controls the pixel circuit area 22.
[0011] <Pixel substrate> Figure 2 shows an example of the configuration of the sensor chip 11. The pixel area 12 of the sensor chip 11 includes multiple pixels 201 arranged in a two-dimensional manner across multiple rows and columns. Each pixel 201 is equipped with a photoelectric conversion unit 202 that includes an avalanche photodiode (hereinafter referred to as APD) that outputs a signal in response to an incident photon. Figure 2 shows 48 pixels 201 arranged in 6 rows from row 0 to row 5 and 8 columns from column 0 to column 7, along with codes indicating the row and column numbers. For example, the unit pixel 11 arranged in the 1st row and 4th column is labeled "P14". The number of rows and columns of the pixel array forming the pixel area 12 is not particularly limited.
[0012] <Circuit board> Figure 3 shows an example of the configuration of a circuit chip 21. The circuit chip 21 includes a pixel circuit region 22 and a peripheral circuit region 23.
[0013] <Pixel circuit area> The pixel circuit region 22 is arranged in a two-dimensional manner across multiple rows and columns, and includes a signal processing unit 301 corresponding to the pixels 201 of the sensor chip. Figure 3 shows 12 signal processing units 301 arranged in three rows (row 0 to row 2) and four columns (column 0 to column 3), along with symbols indicating the row and column numbers. For example, the signal processing unit 301 located in the second row and second column is denoted as "S22". The number of rows and columns of the signal processing array forming the pixel circuit region 22 is not particularly limited. The signal processing unit is equipped with a photon counter 403 for counting the number of photons and a time counter 406 for measuring time. In the photoelectric conversion device of this embodiment, photon counters 403a to 403d are provided for each pixel, but the time counter 406 is shared by multiple pixels. In other words, within the pixel region 12, a set of multiple pixels is considered as a single subpixel region, and photon counters 403a, b, c, and d are placed for each pixel, while time counters 406 are placed for each subpixel region. This configuration reduces the circuit size. Further details will be described later.
[0014] <Peripheral Circuit Area> The peripheral circuit region 23 includes a vertical scanning circuit 302, a column circuit 303, a horizontal scanning circuit 304, a control pulse generation unit 305, a signal restoration unit 306, and a signal output circuit 307. In each row of the signal processing unit array in the pixel circuit region 22, a vertical selection line 311VSEL is arranged to extend in the first direction (the horizontal direction in FIG. 3). The vertical selection line 311VSEL is connected to each of the signal processing units 301 arranged in the first direction and forms a signal line. The first direction in which the vertical selection line 311VSEL extends may be referred to as the row direction or the horizontal direction. In FIG. 3, the control line VSEL is shown together with a symbol indicating the row number. For example, the control line of the first row is labeled with the symbol "VSEL[1]". The vertical selection lines 311VSEL of each row are connected to the vertical scanning circuit 302. The vertical scanning circuit 302 supplies a vertical selection signal for selectively driving the signal processing unit 301 to the signal processing unit 301 via the vertical selection line 311VSEL. In this embodiment, the vertical selection line 311 is divided into a read vertical selection line for reading signals of a plurality of signal processing units 301 in each row and a reset vertical selection line for resetting signals of a plurality of signal processing units 301 in each row.
[0015] In each column of the signal processing unit array in the pixel circuit region 22, a vertical signal line 310 is arranged to extend in a second direction (the vertical direction in FIG. 3) intersecting the first direction. The vertical signal line 310 is connected to each of the signal processing units 301 arranged in the second direction and forms a common signal line. The second direction in which the vertical signal line 310 extends may be referred to as the column direction or the vertical direction. In FIG. 3, the vertical signal line 310 is shown together with a symbol indicating the column number. For example, the vertical signal line 310 of the third column is labeled with the symbol "POUT[3]". The vertical signal line 310 of each column includes n signal lines for outputting an n-bit digital signal.
[0016] The horizontal scanning circuit 304 supplies a horizontal selection signal for reading signals from the column circuits 303 to the column circuits 303. The horizontal scanning circuit 304 supplies control signals to the column circuits 303 of each column via the horizontal selection lines 313 HSEL. The column circuit 303 that has received the horizontal selection signal from the horizontal scanning circuit 304 sequentially outputs the held signal to the horizontal output circuit 307 via the signal line 312 HSIG and via the signal restoration unit 306. In FIG. 3, the horizontal selection line HSEL is shown together with the symbol indicating the column number. For example, the horizontal selection line of the third column is labeled with the symbol "HSEL[3]".
[0017] The control pulse generation unit 305 supplies a control pulse signal for controlling the operations and their timings of the vertical scanning circuit 302, the horizontal scanning circuit 304, and the column circuits 303. Note that at least a part of the control pulse signal for controlling the operations and their timings of the vertical scanning circuit 302, the horizontal scanning circuit 304, and the column circuits 303 may be supplied from outside the photoelectric conversion device. The signal restoration unit 306 calculates a pixel value from the measured value of the time counter 406 and outputs it to the horizontal output circuit 307. The horizontal output circuit 307 outputs a signal corresponding to the pixel value restored by the signal restoration unit 306 as the output signal SOUT of the photoelectric conversion device. Note that a configuration in which the value of the time counter is output as it is, that is, a configuration in which the signal restoration unit 306 is provided outside the photoelectric conversion device, may also be used.
[0018] <Pixel Circuit> FIG. 4 is an example of an equivalent circuit and a block diagram of the pixel 201 in FIG. 2 and the signal processing unit 301 in FIG. 3. FIG. 4 shows one signal processing unit 301 and four corresponding pixels 201a, 201b, 201c, and 201d. Here, a set of a plurality of pixels is regarded as one sub-pixel region. The photon counters 403a, b, c, and d are arranged for each pixel, while the time counter 406 is arranged for each sub-pixel region. Note that hereinafter, when it is necessary to distinguish the four pixels, the symbols a, b, c, and d are given, and when there is no need to distinguish them, the symbols are omitted.
[0019] The pixel 201 in the sensor chip 11 includes an APD202, which is a photoelectric conversion unit. When a photon is incident on the APD202, a charge pair is generated by photoelectric conversion. A voltage VL (first voltage) is supplied to the anode of the APD202. In addition, a voltage VH (second voltage), which is higher than the voltage VL supplied to the anode, is supplied to the cathode of the APD202 via a switch element 408. A reverse bias voltage is supplied to the anode and cathode such that the APD202 performs avalanche multiplication. By supplying such voltages, the charge generated by the incident light undergoes avalanche multiplication, and an avalanche current is generated.
[0020] When a reverse bias voltage is supplied, there are two modes of operation: Geiger mode, where the potential difference between the anode and cathode is greater than the breakdown voltage, and linear mode, where the potential difference between the anode and cathode is near or below the breakdown voltage. An APD operating in Geiger mode is called a SPAD (Single Photon Avalanche Diode). For example, the voltage VL (first voltage) is -30V and the voltage VH (second voltage) is 1V.
[0021] The signal processing unit 301 in the circuit chip 21 includes a quench element 401, a waveform shaping unit 402, a photon counter 403, a switch 404, a determination circuit 405, a time counter 406, a selection circuit 407, and a timing control circuit 410.
[0022] The quench element 401 is connected to the APD202 and a power supply that provides voltage VH. The quench element 401 has the function of converting the change in avalanche current generated in the APD202 into a voltage signal. When the signal is multiplied by avalanche multiplication, the quench element 401 functions as a load circuit (quench circuit) and suppresses the voltage supplied to the APD202, thereby suppressing avalanche multiplication (quench operation).
[0023] The waveform shaping unit 402 shapes the cathode potential change of the APD202 obtained during photon detection and outputs a pulse signal. The waveform shaping unit 402 may use, for example, an inverter circuit or a buffer circuit.
[0024] The photon counter 403 is a photon counter that measures the number of photons incident on a pixel, and counts the pulse signal output from the waveform shaping unit 402 up to, for example, a first threshold Cx. The photon counter 403 also resets the measured value when a predetermined control signal is supplied via the vertical selection line 311.
[0025] As described above, the APD202, quench element 401, waveform shaping unit 402, and photon counter 403 are provided for each pixel. On the other hand, the OR circuit 404, decision circuit 405, and time counter 406, which will be described below, are provided one for every four pixels (i.e., one subpixel region). In addition, one selection circuit 407 is provided for each photon counter 403, and one is provided for each time counter 406.
[0026] The switch 404, the determination circuit 405, and the timing control circuit 410 are responsible for connecting the counter with the highest measured value among the four photon counters 403a, 403b, 403c, and 403d to the time counter 406. For example, at the start of counting, photon counter 403a and time counter 406 are connected by switch 404. Then, during the photon counting process, switch 404 is switched to connect the photon counter 403, which has the highest count among photon counters 403a, 403b, 403c, and 403d, to the time counter 406. Further details will be described later.
[0027] Furthermore, the determination circuit 405 determines whether the measured value of the photon counter 403, to which the time counter 406 is connected, has reached a first threshold Cx. The time counter 406 measures the time from when the photon counter 403 starts measuring until the measured value reaches the first threshold Cx, and outputs the measured time as a pixel value. That is, when the determination circuit 405 determines that the measured value of the photon counter 403 has reached the first threshold Cx, the determination circuit 405 outputs "1", and in response, the time counter 406 holds the measured time at that point as a pixel value. Then, when a request signal is received from a request circuit (not shown), the time counter 406 sends the held measured value to the peripheral circuit. The first threshold value of the measured value The output of the determination circuit 405 is also connected to four photon counters 403a, 403b, 403c, and 403d, and when the determination circuit 405 outputs "1", all four photon counters stop counting photons and hold their respective photon measured values.
[0028] The timing control circuit 410 controls the timing of switching the connection of the time counter 406 based on predetermined conditions. For example, the connection may be switched at regular intervals, or the timing may be determined based on the measurement value of the photon counter. Detailed operation will be described later. By switching the connection of the time counter shared by multiple photon counters according to the timing, photons can be measured efficiently. In Figure 4, an example is shown in which the timing control circuit is placed for each subpixel region, but the timing control circuit may also be placed for each pixel.
[0029] <Explanation of effects> As mentioned above, time counter 406 is connected to photon counter 403, which has the highest count among photon counters 403a, 403b, 403c, and 403d. Therefore, time counter 406 measures the time from when light starts to enter the pixel until the pixel saturates, at the pixel among pixels 201a, 201b, 201c, and 201d that receives the largest amount of incident light per unit time.
[0030] A shorter time to saturation means that a larger amount of light (brighter) is incident on the pixel per unit time. Therefore, by measuring the time to saturation, the brightness information of the brightest of the four pixels can be obtained from the measurement value of the time counter 406.
[0031] Of the four photon counters, the measurement value of the brightest pixel is always the first threshold, while the other three photon counters record the individual photon measurements at the point when the measurement value of the brightest pixel reaches the first threshold. Therefore, from the measurement value of photon counter 403, it is possible to obtain relative brightness information for the three pixels other than the brightest pixel with respect to the brightest pixel. Thus, by combining the measurement value of time counter 406 and the measurement value of the photon counters, it is possible to obtain brightness information for all four pixels. The specific pixel signal reconstruction process will be described later.
[0032] <Selection Circuit> The selection circuit 407 switches the electrical connection between the photon counter 403, the time counter 406 and the vertical signal line 310 based on the vertical selection signal VSEL for reading the nth row, which is supplied from the vertical scanning circuit 302 in Figure 3 via the vertical selection line 311. The sequentially read pixel measurements and time measurements are sent to the column circuit 303 and output to the outside of the photoelectric converter 100 via the signal restoration unit 306 and the horizontal output circuit 307. After the selection circuit 407 reads the pixel measurements and time measurements based on the selection signal supplied from the vertical selection line 311, the photon counter and time counter are reset by the reset signal supplied via the vertical selection line 311 and restart their respective counts.
[0033] In Figure 4, a separate vertical signal line 310 is provided for the time counter in addition to the vertical signal lines 310 for the photon counters in each row, but other configurations are also possible.
[0034] For example, since the photon measurement value of the brightest pixel among the four pixels should always match the first threshold, the time measurement value may be read instead of the photon measurement value of the brightest pixel. Specifically, the time measurement value should be read when a control signal is received via the vertical selection signal VSEL to read the photon measurement value of the pixel to which the time counter is connected. This configuration is preferable because it reduces the amount of signal to be read and thus reduces power consumption.
[0035] Alternatively, a flag signal for identifying the pixel that has reached the first threshold among the four pixels, the time measurement value of the pixel that has reached the first threshold, and the photon measurement values of the three pixels that have not reached the first threshold may be combined and output on a single signal line using a multiplexer circuit or the like.
[0036] <Photon counter switching: Modification example 1> Here, we will explain how to switch the photon counter to which the time counter is connected using switch 404 during the photon counting process. First, we will explain the first method, which involves sequentially switching the switches of each pixel using the peripheral scanning circuit. In this method, the timing control circuit 410, which controls the timing of selecting the pixel to perform time measurement, is located in the peripheral scanning circuit section, as shown in Figure 4a.
[0037] As mentioned above, the time counter 406 counts the time until the measurement value of any of the photon counters 403a, 403b, 403c, or 403d reaches a first threshold Cx. Therefore, the switch 404 needs to compare the measurements of the photon counters 403a, 403b, 403c, and 403d before the measurement value of the photon counter reaches a specific threshold and before the time counter reaches a threshold (first predetermined time).
[0038] Therefore, the photoelectric converter 100 sends a request signal from the request signal transmission circuit in the vertical scanning circuit 110 in Figure 3 to the signal processing unit 301 of each pixel via the vertical selection line 311 at regular intervals (a second predetermined time shorter than the first predetermined time). When the signal processing unit 301 receives a request signal from the request signal transmission circuit, the determination circuit 405 determines whether any of the four photon counters 403a, 403b, 403c, and 403d has reached a second threshold smaller than the first threshold, and sends the determination result to the vertical scanning circuit 110. Upon receiving the determination result, the vertical scanning circuit 110 switches the connection destination of the time counter to the photon counter that has reached the second threshold.
[0039] By sending the request signal multiple times during the completion of one frame, the connection destination of the time counter can be switched when the largest measurement value among the four photon counters 403a, 403b, 403c, and 403d reaches the second threshold. In other words, the connection destination of the time counter can be switched to the brightest pixel among the four pixels before the measurement value of the brightest pixel among the four pixels reaches the first threshold. With this configuration, brightness information of the brightest pixel among the four pixels can be obtained from the measurement value of the time counter 406.
[0040] In other words, the photoelectric converter in this embodiment reduces the circuit size by sharing a time counter among multiple pixels. The problems arising from sharing the time counter among multiple pixels are solved by switching the connection destination of the time counter midway through the process. The problems will be explained below.
[0041] Figure 5 illustrates the relationship between time and photon measurement values. Figure 5(a) shows the case where the pixel to which the time counter is connected has the highest sensitivity among multiple pixels sharing a time counter. On the other hand, Figure 5(b) shows the case where, among multiple pixels sharing a time counter, there are other pixels with higher sensitivity than the pixel to which the time counter is connected.
[0042] As shown in Figure 5(a), when the pixel sensitivity of the photon counter connected to the time counter is the highest, brightness information for multiple pixels can be obtained by measuring the time it takes for the photon counter connected to the time counter to saturate. On the other hand, as shown in Figure 5(b), if there are other pixels with higher pixel sensitivity than the photon counter connected to the time counter, the photon counter without the time counter will saturate before the photon counter connected to the time counter saturates. In that case, even if the time it takes for the photon counter connected to the time counter to saturate is measured, it is not possible to obtain brightness information for pixels that have already saturated. Thus, when a time counter is shared among multiple pixels, brightness information may not be obtained correctly depending on the subject.
[0043] To solve this problem, the photoelectric converter in this embodiment switches the connection destination of the time counter to the pixel with the highest pixel sensitivity, thereby preventing the photon counter, to which the time counter is not connected, from becoming saturated.
[0044] <Counter switching: Variation 2> Next, we will explain the second method, in which a circuit for switching a switch is placed at each pixel. In this method, the timing control circuit 410, which controls the timing of selecting the pixel for time measurement, is located at the signal processing unit of each pixel, as shown in Figure 4b.
[0045] As mentioned above, the time counter 406 counts the time until the measurement of the photon counter with the highest count among photon counters 403a, 403b, 403c, and 403d reaches a first threshold. Therefore, the switch 404 needs to compare the measurements of photon counters 403a, 403b, 403c, and 403d before the measurement of the photon counter reaches a specific threshold.
[0046] Therefore, the determination circuit 405 determines whether any of the photon counters 403a, 403b, 403c, or 403d has reached a second threshold that is smaller than the first threshold. Then, the connection destination of the time counter is switched to the photon counter that has reached the second threshold. For example, if the first threshold is the saturation level and the second threshold is half the saturation level, the determination circuit 405 can be equipped with a logical OR circuit for the upper two bits of the measured values of the four photon counters, and when the output of the logical OR circuit becomes 1, the connection destination of the time counter can be switched. With this configuration, brightness information of the brightest pixel among the four pixels can be obtained from the measured value of the time counter 406.
[0047] <Multiple switching operations: Modification 3> Note that the counter switching can be controlled multiple times within a single frame. For example, if the difference in the measured values of multiple photon counters is small, it may be impossible to predict which photon counter will saturate first due to the influence of photon shot noise. Therefore, when any of the multiple photon counters reach the second threshold, if the difference in the measured value between photon counter A, which has the largest measured value, and photon counter B, which has the next largest measured value, is smaller than the third threshold, it is better to switch the counters again. The third threshold can be determined by the photon shot noise, for example, by setting it to the square root of the second threshold or about twice that value.
[0048] Specifically, after switching the counters once, it is determined whether any of the multiple photon counters have reached a fourth threshold that is greater than the second threshold and less than the first threshold. Then, the connection destination of the time counter is switched to the photon counter that has reached the fourth threshold. By switching the connection destination of the time counter multiple times in this way, the probability that the time counter is connected to the pixel with the highest pixel sensitivity is increased. At this time, only photon counter A and photon counter B are needed to determine whether the fourth threshold has been reached. This is because, even considering the effects of photon shot noise, the photon counters other than photon counters A and B are less likely to saturate before photon counters A and B.
[0049] <Signal Restoration Unit> The signal restoration unit 306 restores the time measurement value counted by the time counter 406 and the photon measurement value counted by the photon counter 403 into a pixel signal representing the brightness information of the subject. When the time measurement value is T0 and the photon measurement values of the four pixels 201a, 201b, 201c, and 201d are P1, P2, P3, and P4 respectively, the respective pixel signal values C1, C2, C3, and C4 can be calculated using the following formulas. C1 = K × P1 / T0, C2 = K × P2 / T0 C3 = K × P3 / T0, C4 = K × P4 / T0 K is a natural number, and it is preferable to choose a value such that C1, C2, C3, and C4 are not less than 1 LSB. Specifically, K can be set to the maximum value of the time measurement.
[0050] <Outputting photon measurement values after a certain period of time: Modification example 4> Furthermore, the determination circuit 405 may be configured to stop the time counter 406 and output the photon measurement value at that time if the measured value of the photon counter to which the time counter is connected does not reach the first threshold even after a predetermined time (first predetermined time) has elapsed. By using such a configuration, the problem of the frame rate becoming slow when the brightness of the subject is very dark can be solved. It is preferable to set the predetermined time to the maximum value of the time count.
[0051] <Spectral sensitivity, Bayer array> In the examples shown in Figures 3 and 4, one signal processing unit 301 is connected to four pixels 201. However, the circuit size can be reduced if the number of pixels connected to one signal processing unit 301 is two or more. Specifically, the photon counter can be set up for each pixel, and the time counter can be shared by multiple pixels.
[0052] Furthermore, each pixel 201 may have an on-chip color filter and be configured to acquire spectral information. For example, if a Bayer array color filter is assumed, it is preferable to provide one signal processing unit 301 for 4 pixels in a 2x2 arrangement, as this enables the acquisition of brightness information on a Bayer pixel basis. In other words, it is preferable that at least some of the pixels sharing a time counter have different spectral sensitivities.
[0053] If the spectral sensitivity of each pixel is the same, the pixel count values of multiple pixels may reach the first threshold Cx simultaneously. In this case, the time measurement value at the point when multiple pixels reach the first threshold Cx is stored as the pixel value. Then, when a request signal is received from a request circuit (not shown), the stored measurement value of the time counter 406 is sent to the peripheral circuit. After that, the connection destination of the time counter is connected to one of the pixels that has not yet reached the first threshold Cx. After that, the same operation should be repeated each time the pixel count value of the pixel to which the time counter is connected reaches the first threshold Cx.
[0054] Furthermore, in the case of a Bayer array, the green pixel has the highest sensitivity for typical subjects, so it is preferable to initially connect the time counter to the green pixel. Moreover, when acquiring a multi-frame video, it is even preferable to compare the values of the red, green, and blue pixels of the previous frame and, in the next frame, connect the time counter to the pixel with the highest sensitivity in the previous frame.
[0055] <Imaging device> Figure 6 is a block diagram of the imaging device 500 using the photoelectric converter 100.
[0056] The imaging device 500 is, for example, a digital camera, and is an imaging device including a photoelectric converter 100, a lens 501, an image processing unit 502, an optical control unit 503, a storage unit 504, and a wireless I / F (Interface) unit 505 as a communication unit.
[0057] Lens 501 forms an optical image of the subject and directs the formed optical image onto the imaging surface of the photoelectric converter 100, which is equipped with a focus lens, zoom lens, and aperture. The photoelectric converter 100 captures the optical image formed by lens 501. The signal read from photoelectric converter 100 is output to image processing unit 502. Image processing unit 502 processes the signal output from photoelectric converter 100, including signal rearrangement, defective pixel correction, noise reduction, color conversion, white balance correction, gamma correction, and data compression, to generate an image. The image processing unit 502 has a built-in CPU and functions as a control means that controls the operation of each part of the entire imaging device 500 based on a computer program stored in memory as a storage medium. The optical control unit 503 controls the focus lens, zoom lens, aperture, etc., provided on lens 501. A recording medium (not shown) is mounted in the recording unit 504 and saves the video output from the image processing unit to the storage medium. For example, a memory card may be used as the recording medium. Alternatively, a hard disk may be used. The wireless I / F (Interface) unit 505, which acts as the communication unit, outputs the image signal generated by the image processing unit 502 to the outside of the imaging device 500. 506 is a network, which consists of multiple routers, switches, cables, etc. that satisfy a communication standard such as Ethernet (registered trademark), and a client controls the imaging device 500 via the network 506.
[0058] <Flowchart> Figure 7 is a flowchart illustrating the operation performed by the photoelectric conversion device of the present invention. In the following description, each step is preceded by an S, and the notation of the step is omitted. In S700, switch 404 initially connects time counter 406 to one of the four photon counters 403a, 403b, 403c, and 403d. The initial connection destination may be arbitrarily selected, or information from the previous frame may be used.
[0059] In S701, it is determined whether the measured value of any of the four photon counters has reached the second threshold. If the measured value has not reached the second threshold, the time counter remains connected to its initial setting, and the photon count and time count continue. If the measured value has reached the second threshold, the process proceeds to S702, where the time counter is switched to the photon counter that has reached the second threshold.
[0060] In S703, it is determined whether the measured value of the photon counter connected to the time counter after the switch has reached a first threshold. Then, in S704, when the measured value of the photon counter reaches the first threshold, the time count on the time counter is stopped, and the number of photons and the time count are output.
[0061] <Other Embodiments> In the embodiments described, an example was given in which the imaging device was applied to a digital camera, for example. However, the imaging device includes electronic devices with imaging capabilities such as digital movie cameras, smartphones with cameras, tablet computers with cameras, in-vehicle cameras, drone cameras, cameras mounted on robots, and network cameras.
[0062] Although the present invention has been described in detail above based on its preferred embodiments, the present invention is not limited to the above embodiments, and various modifications are possible based on the spirit of the present invention, and these modifications are not excluded from the scope of the present invention.
[0063] Furthermore, in this embodiment, some or all of the control may be provided to a photoelectric converter, imaging device, etc., via a network or various storage media, by supplying a computer program that realizes the functions of the above-described embodiment to the photoelectric converter, imaging device, etc. The computer (or CPU, MPU, etc.) in the photoelectric converter, imaging device, etc., may then read and execute the program. In that case, the program and the storage medium storing the program constitute the present invention. [Explanation of Symbols]
[0064] 100 Photoelectric converter 500 Imaging device 501 Lens 502 Image Processing Unit 503 Optical Control Unit 504 Storage section 505 I / F section
Claims
1. A photoelectric conversion device having pixels each including a photoelectric conversion unit that outputs a signal in response to an incident photon, a first measuring means for measuring the number of the photons incident on the pixel; a second measuring means for measuring a time from when the first measuring means starts the measurement until when the measured value of the first measuring means reaches a first threshold value; a selection means for switching a first measurement means to be connected to the second measurement means among the plurality of first measurement means; and a control means for controlling a timing for switching the connection of the second measurement means by the selection means.
2. The photoelectric conversion device according to claim 1, characterized in that the control means determines whether or not to switch the connection of the second measurement means by the selection means based on the measurement values of each of the plurality of first measurement means at predetermined time intervals.
3. the control means is arranged for each partial pixel region formed of a plurality of the pixels, and determines whether or not a measurement value by the first measurement means corresponding to the pixel included in the partial pixel region is greater than a second threshold value that is smaller than the first threshold value; 3. The photoelectric conversion device according to claim 1, wherein the selection means switches the connection to the first measurement means whose measurement value is greater than the second threshold value.
4. 4. The photoelectric conversion device according to claim 3, wherein the selection means connects the second measurement means to the first measurement means having the largest measurement value by the first measurement means corresponding to the pixel included in the partial pixel region.
5. the control means is arranged for each of the pixels and determines whether or not a measurement value by the first measurement means corresponding to each of the pixels is greater than a second threshold value that is smaller than the first threshold value; 3. The photoelectric conversion device according to claim 1, wherein the selection means switches the connection to the first measurement means whose measurement value is greater than the second threshold value.
6. 6. The photoelectric conversion device according to claim 1, further comprising an output unit that outputs a measurement value obtained by the first measurement unit or a measurement value obtained by the second measurement unit that corresponds to the pixel.
7. The photoelectric conversion device according to claim 6, characterized in that the output means outputs measurement values by the first measurement means corresponding to each of the plurality of pixels other than the first measurement means that has reached the first threshold value, and measurement values by the second measurement means.
8. The photoelectric conversion device according to claim 6 or 7, characterized in that the output means outputs a single signal including the measurement value of the first measurement means and the measurement value of the second measurement means included in a partial pixel area consisting of a plurality of the pixels.
9. 9. The photoelectric conversion device according to claim 6, wherein the output means outputs the measurement value by the first measurement means corresponding to each of the pixels when the measurement value by the second measurement means reaches a first predetermined time.
10. 9. The photoelectric conversion device according to claim 1, further comprising a signal restoration means for restoring a pixel signal based on a measurement value by the first measurement means corresponding to each pixel or a measurement value over time by the second measurement means.
11. the first measuring means is disposed for each of the plurality of pixels, 11. The photoelectric conversion device according to claim 1, wherein the second measurement means is disposed for each partial pixel region including a plurality of the pixels having different spectral sensitivities from each other.
12. 12. The photoelectric conversion device according to claim 11, wherein the second measurement means is connected to the first measurement means corresponding to a pixel that had the highest sensitivity in a previous frame among the plurality of pixels.
13. the photoelectric conversion device has red, blue and green pixels; 12. The photoelectric conversion device according to claim 11, wherein the second measurement means is connected to the first measurement means corresponding to the green pixel in an initial state.
14. the control means determines, based on a request signal, whether or not the measurement values of the first measurement means corresponding to each of the plurality of pixels have reached a second threshold value that is smaller than the first threshold value; 14. The photoelectric conversion device according to claim 1, wherein the selection means switches the connection of the second measurement means to the first measurement means whose measurement value has reached the second threshold value based on the determination result.
15. 15. The photoelectric conversion device according to claim 1, wherein the control means controls the timing of selecting a pixel for time measurement a plurality of times within one frame.
16. 16. The photoelectric conversion device according to claim 1, wherein the photoelectric conversion unit includes an avalanche photodiode that detects incidence of photons.
17. An imaging device comprising the photoelectric conversion device according to claim 1 .
18. A method for controlling a photoelectric conversion device having a pixel having a photoelectric conversion unit that outputs a signal in response to an incident photon, a first measurement means that measures the number of the photons incident on the pixel, and a second measurement means that measures a time from when the first measurement means starts the measurement until a measurement value of the first measurement means reaches a first threshold, comprising: a selection step of switching a first measurement means to be connected to the second measurement means among the plurality of first measurement means; and a control step of controlling a timing for switching the connection of the second measurement means by the selection step.
19. A computer program for controlling each unit of the photoelectric conversion device according to any one of claims 1 to 16 or the imaging device according to claim 17 by a computer.
