Solid-state imaging device

The solid-state imaging device addresses the high cost and power consumption of existing systems by using pixel arrays with row and column control lines to selectively output charges, enabling efficient image acquisition without a spatial light modulator.

JP7590211B2Active Publication Date: 2024-11-26HAMAMATSU PHOTONICS KK
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2021027232
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-02-24
Publication Date
2024-11-26
Estimated Expiration
2041-02-24

AI Technical Summary

Technical Problem

Existing imaging devices requiring a spatial light modulator and photodetector increase cost and power consumption, making it difficult to construct an optical system.

Method used

A solid-state imaging device with two-dimensionally arranged pixels, each including a photodiode, connected by row and column control lines, that selectively output charges to row and column output lines based on control signals, eliminating the need for a spatial light modulator.

Benefits of technology

The device enables easy acquisition of images using compressed sensing technology, reducing cost and power consumption while simplifying optical system construction.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007590211000001
    Figure 0007590211000001
  • Figure 0007590211000002
    Figure 0007590211000002
  • Figure 0007590211000003
    Figure 0007590211000003
Patent Text Reader

Abstract

To provide a solid-state imaging device with which image acquisition by compressed sensing technologies can be easily performed.SOLUTION: A solid-state imaging device 1 includes a pixel array unit 10, a row control unit 21, a row readout unit 22, a column control unit 31, and a column readout unit 32. The pixel array unit 10 includes MN pixels P1,1 to PM,N that each include a photodiode generating a charge in response to receiving light and are arrayed in a two-dimensional matrix that has M rows and N columns. An m-th row control signal Xm output from the row control unit 21 to an m-th row control line 23m and an n-th column control signal Yn output from the column control unit 31 to an n-th column control line 33n are input into a pixel Pm,n, and, based on respective logical values for the input m-th row control signal Xm and the input n-th column control signal Yn, the pixel Pm,n selects whether to output the charge generated by the photodiode thereof to an m-th row output line 24m or an n-th column output line 34n.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a solid-state imaging device. [Background technology]

[0002] The imaging device described in Non-Patent Document 1 includes a spatial light modulator capable of modulating the intensity ratio of output light to input light for each pixel, and a photodetector that detects the intensity of the input light, and can acquire an image of an object by compressive sensing technology. In the imaging device described in this document, an image of an object is formed on the modulation surface of the spatial light modulator, and the spatial light modulator performs optical amplitude modulation for each pixel based on a set optical amplitude modulation pattern, and the intensity of the modulated light is detected by a photodetector. A plurality of types of optical amplitude modulation patterns are set in the spatial light modulator in sequence, and when each optical amplitude modulation pattern is set, a light intensity value is acquired by the photodetector, and each optical amplitude modulation pattern and the corresponding light intensity value are stored in a storage unit. Then, an image of the object can be acquired by analyzing the plurality of sets of optical amplitude modulation patterns and light intensity values ​​stored in the storage unit.

[0003] The photodetector used in this imaging device does not need to be an image sensor in which multiple pixels are arranged to detect the intensity distribution of the beam cross section of the input light, but may be a point sensor consisting of a single pixel. Therefore, imaging by an imaging device using a point sensor is effective when it is required to image an object in a wavelength range in which the use of an image sensor is not appropriate, or when it is required to image an object with lower noise or higher performance than an image sensor. In addition, if the image to be obtained by imaging is sparse, it is possible to obtain an image of the object using a number of optical amplitude modulation patterns less than the number of pixels by using compressed sensing technology. [Prior art documents] [Non-patent literature]

[0004] [Non-Patent Document 1] Marco F. Duarte, et al., “Single-PixelImaging via Compressive Sampling.” IEEE Signal Processing Magazine, Vol.25, Issue 2, pp.83-91 (Mar. 2008). Summary of the Invention [Problem to be solved by the invention]

[0005] The imaging device described in Non-Patent Document 1 requires an optical system to be constructed using a spatial light modulator in addition to a photodetector, which increases costs and power consumption and makes it difficult to construct the optical system.

[0006] The present invention has been made to solve the above problems, and has an object to provide a solid-state imaging device that can easily acquire images using compressed sensing technology. [Means for solving the problem]

[0007] A solid-state imaging device of the present invention includes: (1) M pixels, each including a photodiode that generates charge in response to receiving light, two-dimensionally arranged in M ​​rows and N columns (M and N are integers of 2 or more); (2) a row control unit connected to N pixels in an m-th row (m is an integer between 1 and M) of the M rows and N columns by an m-th row control line, and providing an m-th row control signal to the N pixels in the m-th row via the m-th row control line; (3) a row readout unit connected to N pixels in the m-th row of the M rows and N columns by an m-th row output line, and inputting charges generated in the photodiodes of each of the N pixels in the m-th row and output to the m-th row output line; (4) a column control unit connected to M pixels in the n-th column (n is an integer between 1 and N) of the M rows and N columns by an n-th column control line, and providing the n-th column control signal to the M pixels in the n-th column via the n-th column control line; and (5) and a column readout unit that is connected to M pixels in the nth column of the M rows and N columns by the nth column output line, and inputs charges generated in the photodiodes of the M pixels in the nth column and output to the nth column output line. The pixel in the mth row and nth column of the MN pixels selects whether to output the charge generated in the photodiode to the mth row output line or the nth column output line based on the logical values ​​of the mth row control signal and the nth column control signal.

[0008] In one aspect of the present invention, it is preferable that a plurality of m-th row control lines are provided, it is preferable that a plurality of n-th column control lines are provided, it is preferable that a plurality of m-th row output lines are provided, and it is also preferable that a plurality of n-th column output lines are provided.

[0009] In one aspect of the present invention, the row readout unit preferably includes one or more capacitors for storing the charge input via the m-th row output line. The row readout unit preferably outputs a voltage value corresponding to the total amount of the charge input via all the m-th row output lines. Alternatively, the row readout unit preferably sequentially outputs voltage values ​​corresponding to the amount of the charge input via the m-th row output line.

[0010] In one aspect of the present invention, the column readout unit preferably includes one or more capacitors for storing the charge input via the n-th column output line. The column readout unit preferably outputs a voltage value according to the total amount of the charge input via all of the n-th column output lines. Alternatively, the column readout unit preferably sequentially outputs voltage values ​​according to the amount of the charge input via the n-th column output line.

[0011] In one aspect of the present invention, the row control unit preferably includes a shift register that receives the first to Mth row control signals as serial data and outputs the mth row control signal to the mth row control line. Also, the row control unit preferably includes a flip-flop that latches the mth row control signal output from the shift register and outputs the latched mth row control signal to the mth row control line.

[0012] In one aspect of the present invention, the column control unit preferably includes a shift register that receives the first to Nth column control signals as serial data and outputs the nth column control signal to the nth column control line. Also, the column control unit preferably includes a flip-flop that latches the nth column control signal output from the shift register and outputs the latched nth column control signal to the nth column control line.

[0013] In one aspect of the present invention, it is preferable that the pixel in the mth row and the nth column includes, as a photodiode, a photodiode connected to the mth row output line and a photodiode connected to the nth column output line separately. Alternatively, it is preferable that the pixel in the mth row and the nth column includes one photodiode, and when outputting a charge generated in the photodiode, the charge is output to only one of the mth row output line and the nth column output line. Effect of the Invention

[0014] According to the present invention, image acquisition using compressed sensing technology can be easily performed. [Brief description of the drawings]

[0015] [Figure 1]FIG. 1 is a diagram showing the overall configuration of a solid-state imaging device 1 of the present embodiment. [Diagram 2] FIG. 2 is a diagram showing an example of a circuit configuration of the column readout unit 32. As shown in FIG. [Diagram 3] FIG. 3 is a diagram showing another example of the circuit configuration of the column readout section 32. In FIG. [Figure 4] FIG. 4 is a diagram showing yet another example of the circuit configuration of the column readout section 32. In FIG. [Diagram 5] FIG. 5 is a diagram showing an example of a circuit configuration of the column control unit 31. As shown in FIG. [Figure 6] FIG. 6 is a diagram showing an example of the circuit configuration of pixel Pm,n. [Figure 7] FIG. 7 is a diagram showing an example of charge output of each pixel in the pixel array section 10 when pixel Pm,n has the circuit configuration example of FIG. [Figure 8] FIG. 8 is a diagram showing another example of the circuit configuration of the pixel Pm,n. [Figure 9] FIG. 9 is a diagram showing an example of charge output of each pixel in the pixel array section 10 when pixel Pm,n has the circuit configuration example of FIG. [Figure 10] FIG. 10 is a diagram showing another example of the circuit configuration of the pixel Pm,n. [Figure 11] FIG. 11 is a diagram showing an example of charge output of each pixel in the pixel array section 10 when pixel Pm,n has the circuit configuration example of FIG. [Figure 12] FIG. 12 is a diagram showing another example of the circuit configuration of the pixel Pm,n. [Figure 13] FIG. 13 is a diagram showing another example of the circuit configuration of the pixel Pm,n. [Figure 14] FIG. 14 is a diagram showing another example of the circuit configuration of the pixel Pm,n. [Figure 15] FIG. 15 is a diagram showing an example of the charge output of each pixel in the pixel array section 10 during the first period when pixel Pm,n has the circuit configuration example of FIG. [Figure 16] FIG. 16 is a diagram showing an example of the charge output of each pixel in the pixel array section 10 during the second period when pixel Pm,n has the circuit configuration example of FIG. [Figure 17]FIG. 17 is a diagram showing an example of the charge output of each pixel in the pixel array section 10 during the third period when the pixel Pm,n has the circuit configuration example of FIG. [Figure 18] FIG. 18 is a diagram showing an example of the charge output of each pixel in the pixel array section 10 during the fourth period when pixel Pm,n has the circuit configuration example of FIG. [Figure 19] FIG. 19 is a diagram showing an example of a timing aspect from exposure to readout when charges are output from all pixels described with reference to FIGS. [Figure 20] FIG. 20 is a diagram showing an example of a timing aspect from exposure to readout when charges are output from all pixels described with reference to FIGS. [Figure 21] FIG. 21 is a diagram showing an example of a timing aspect from exposure to readout when charges are output from all pixels described with reference to FIGS. [Figure 22] FIG. 22 is a diagram showing an example of a timing aspect from exposure to readout when charges are output from all pixels described with reference to FIGS. [Figure 23] FIG. 23 is a diagram showing an example of the charge output of each pixel in the pixel array section 10 during the first period when the pixel Pm,n has the circuit configuration example of FIG. 10 or FIG. [Figure 24] FIG. 24 is a diagram showing an example of the charge output of each pixel in the pixel array section 10 during the second period when pixel Pm,n has the circuit configuration example of FIG. 10 or FIG. [Diagram 25] FIG. 25 is a diagram showing an example of the aspect of timing from exposure to readout when charges are output from all pixels described with reference to FIGS. 23 and 24. In FIG. [Figure 26] FIG. 26 is a diagram showing an example of the aspect of timing from exposure to readout when charges are output from all pixels described with reference to FIGS. 23 and 24. In FIG. [Figure 27] FIG. 27 is a diagram showing an example of the aspect of timing from exposure to readout when charges are output from all pixels described with reference to FIGS. [Figure 28]FIG. 28 is a diagram showing an example of the aspect of timing from exposure to readout when charges are output from all pixels described with reference to FIGS. [Figure 29] FIG. 29 is a diagram showing another example of the circuit configuration of pixel Pm,n. [Diagram 30] FIG. 30 is a diagram showing an example of charge output of each pixel in the pixel array section 10 when pixel Pm,n has the circuit configuration example of FIG. [Diagram 31] FIG. 31 is a diagram showing another example of the circuit configuration of pixel Pm,n. [Diagram 32] FIG. 32 is a diagram showing another example of the circuit configuration of pixel Pm,n. [Diagram 33] FIG. 33 is a diagram showing an example of charge output of each pixel in the pixel array section 10 when the pixel Pm,n has the circuit configuration example of FIG. 31 or FIG. [Diagram 34] FIG. 34 is a diagram showing another example of the circuit configuration of the pixel Pm,n. [Diagram 35] FIG. 35 is a diagram showing another example of the circuit configuration of pixel Pm,n. [Diagram 36] FIG. 36 is a diagram showing an example of charge output of each pixel in the pixel array section 10 when pixel Pm,n has the circuit configuration example of FIG. 34 or FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0016] Hereinafter, the embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the description of the drawings, the same elements are given the same reference numerals, and duplicated descriptions are omitted. The present invention is not limited to these examples, but is indicated by the claims, and is intended to include all modifications within the meaning and scope equivalent to the claims.

[0017] 1 is a diagram showing the overall configuration of a solid-state imaging device 1 of this embodiment. The solid-state imaging device 1 includes a pixel array section 10, a row control section 21, a row readout section 22, a column control section 31, and a column readout section 32.

[0018] The pixel array unit 10 includes MN pixels P 1,1 ~P M,N Contains MN pixels P 1,1 ~P M,N The pixels P m,n is located in the mth row and nth column. m,n includes a photodiode that generates an electric charge in response to received light, and has a PPS (passive pixel sensor) configuration. Here, M and N are integers of 2 or more. m is an integer of 1 or more and M or less. n is an integer of 1 or more and N or less.

[0019] The row control unit 21 selects N pixels P m,1 ~P m,N and m-th row control line 23 m The m-th row control line 23 is connected by m via the mth row control signal X m The mth row of N pixels P m,1 ~P m,N The row readout unit 22 outputs the N pixels P m,1 ~P m,N and mth row output line 24 m The m-th row of N pixels P m,1 ~P m,N The m-th row output line 24 is generated in each photodiode. m The charge output to is input.

[0020] The column control unit 31 controls M pixels P 1,n ~P M,n and the nth column control line 33 n The n-th column control line 33 is connected by n via the nth column control signal Y n The M pixels P 1,n ~P M,n The column readout unit 32 outputs M pixels P 1,n ~P M,n and nth column output line 34 n The n-th column of M pixels P 1,n ~P M,n The n-th column output line 34 is generated in each photodiode.n The charge output to is input.

[0021] Pixel P m,n The m-th row control line 23 is connected to the row control unit 21. m The mth row control signal X m and the n-th column control line 33 from the column control unit 31. n The nth column control signal Y n Input pixel P m,n These input m-th row control signals X m and the n-th column control signal Y n Based on each logic value, the charge generated in the photodiode is transferred to the m-th row output line 24 m or nth column output line 34 n Select whether to output to.

[0022] MN pixels P of the pixel array unit 10 1,1 ~P M,N Among them, the m-th row output line 24 m and the n-th column output line 34 n The pixels that output charges to the first to Mth row control signals X1 to X M and the first to Nth column control signals Y1 to Y N The first to Mth row control signals X1 to X M or the first to Nth column control signals Y1 to Y N By changing the pattern of the m-th row output line 24 m The pixels that output charges to the n-th column output line 34 can be changed. n It is possible to vary the pixels that output charges to the corresponding pixel.

[0023] Therefore, this solid-state imaging device 1 does not need to use a spatial light modulator that was previously required when acquiring an image using compressed sensing technology, which reduces the increase in cost and power consumption and makes it easier to construct an optical system. In other words, this solid-state imaging device 1 can easily acquire an image using compressed sensing technology.

[0024] When an image is acquired by the compressed sensing technique using this solid-state imaging device 1, the first to Mth row control signals X1 to X M and the first to Nth column control signals Y1 to Y N For each of these, multiple patterns are required. The multiple patterns may be selected randomly or may be set based on the Hadamard matrix.

[0025] In addition, when the solid-state imaging device 1 is used to acquire an image by a compressed sensing technique, the first to Mth row output lines 241 to 24 M and the first to Nth column output lines 341 to 34 N It may be based on the individual amount of charge output to each of the first to Mth row output lines 241 to 24. M The total amount of charges output to the first to Nth column output lines 341 to 34 N It may be based on the total amount of charges output to the first to Mth row output lines 241 to 24 M and the first to Nth column output lines 341 to 34 N The amount of charge output to the sensor 1 may be based on the total amount of charge output to the sensor 1 .

[0026] The m-th row control line may be one or more. When two m-th row control lines are provided, the pixel P m,n The m-th row control signal is applied to the pixel P m,n The n-th column control line may be a signal obtained by logically inverting the m-th row control signal provided to the pixel P. The n-th column control line may be one or more. When two n-th column control lines are provided, one of the n-th column control lines controls the pixel P m,n The n-th column control signal is applied to the pixel P m,n The mth row output line may be one or more. The nth column output line may be one or more.

[0027] Next, an example of the circuit configuration of the column readout section 32 will be described with reference to Figs. 2 to 4. Fig. 2 is a diagram showing an example of the circuit configuration of the column readout section 32. The column readout section 32 shown in this figure includes NMOS transistors 411 to 41. N and a conversion unit 49. NMOS transistor 41 n The drain of the nth column output line 34 n The NMOS transistor 41 is connected to n The source of the NMOS transistor 41 is connected to the conversion unit 49. n acts as a switch that sets the connection between the drain and source to either conductive (ON) or non-conductive (OFF) depending on the level of a signal applied to the gate.

[0028] The conversion unit 49 includes NMOS transistors 411 to 41 N The conversion unit 49 is connected to the sources of the respective input charges. The conversion unit 49 includes a charge amplifier that outputs a voltage value according to the amount of input charge, and an AD converter that outputs a digital value according to the voltage value output from the charge amplifier.

[0029] NMOS transistors 411-41 N When any of the NMOS transistors 41 and 42 is in an on state, the NMOS transistor 41 in the on state n and nth column output line 34 n The M pixels P in the nth column are connected via 1,n ~P M,n The charge output from any one of the pixels is input to the conversion unit 49, and a digital value according to the amount of the charge is output from the conversion unit 49. N may be turned on simultaneously or one by one in sequence.

[0030] This diagram shows NMOS transistors 481 to 48 N Also shown is NMOS transistor 48 n The drain of the NMOS transistor 48 is connected to the power supply potential supply terminal. n The source of the nth column output line 34 n NMOS transistor 48 is connected ton NMOS transistor 48 also acts as a switch. n When in the on state, the n-th column output line 34 n The M pixels P in the nth column connected to 1,n ~P M,n The charge generated in each photodiode can be initialized.

[0031] 3 is a diagram showing another example of the circuit configuration of the column readout section 32. The column readout section 32 shown in this diagram includes NMOS transistors 411 to 41 N In addition to the conversion unit 49, NMOS transistors 421 to 42 N and capacitors 431 to 43 N NMOS transistor 42 n The drain of the nth column output line 34 n NMOS transistor 42 is connected to n The source of the NMOS transistor 41 n The drain of the capacitor 43 is connected to the n 42 NMOS transistor n The NMOS transistor 42 is provided between the source of the NMOS transistor 42 and the ground potential supply terminal. n also acts as a switch.

[0032] In this circuit configuration example, the NMOS transistor 41 n When is in the off state, the NMOS transistor 42 n When the n-th column output line 34 is in the ON state, n The charge arriving from capacitor 43 n Then, the NMOS transistor 42 n When the NMOS transistor 41 is in the off state, n When the on state, the capacitor 43 n The charge stored in the NMOS transistors 411 to 411 is input to the conversion unit 49, and a digital value corresponding to the amount of the charge is output from the conversion unit 49. N may be turned on simultaneously or one by one in sequence.

[0033] 4 is a diagram showing yet another example of the circuit configuration of the column readout section 32. The column readout section 32 shown in this diagram includes NMOS transistors 411 to 41 N , NMOS transistors 421 to 42 N , Capacitor 431 to 43 N , NMOS transistors 441 to 44 N , NMOS transistors 451 to 45 N , Capacitor 461 to 46 N , NMOS transistors 471 to 47 N and a conversion unit 49. NMOS transistor 44 n ,45 n and Capacitor 46 n 41 NMOS transistor n ,42 n and Capacitor 43 n The NMOS transistor 47 has a similar structure. n The drain of the NMOS transistor 41 n ,44 n The conversion unit 49 includes NMOS transistors 471 to 47 N Each is connected to a different source.

[0034] In this circuit configuration example, the n-th column output line 34 n 2 capacitors for 43 n ,46 n By providing the n-th column output line 34 n While the electric charge arriving from the NMOS transistor 41 is transferred to and stored in one of the capacitors, the electric charge stored in the other capacitor is input to the conversion unit 49, and a digital value according to the amount of the electric charge is output from the conversion unit 49. For example, n ,45 n When is in the off state, the NMOS transistor 42 n When the n-th column output line 34 is in the ON state, n The charge arriving from capacitor 43 n and stored in the NMOS transistor 44. n ,47 n When is in the on state, the capacitor 46n The charge stored in the input buffer 44 is input to the conversion unit 49, which then outputs a digital value according to the amount of charge.

[0035] Only one conversion unit that outputs a digital value according to the amount of charge may be provided in the column readout section 32, or one may be provided for each column in the column readout section 32. The row readout section 22 may have a similar configuration to the column readout section 32. Only one conversion unit that outputs a digital value according to the amount of charge may be provided in each of the row readout section 22 and the column readout section 32.

[0036] Next, a description will be given of an example of the circuit configuration of the column control unit 31. The column control unit 31 controls first to N-th column control signals Y1 to Y N Parallel input to generate the n-th column control signal Y n The nth column control line 33 n , and the first to Nth column control signals Y1 to Y N is input as serial data to generate the n-th column control signal Y n The nth column control line 33 n The column control unit 31 may preferably have a configuration shown in FIG.

[0037] 5 is a diagram showing an example of a circuit configuration of the column control unit 31. The column control unit 31 shown in this diagram includes a shift register 51 and flip-flops 521 to 52. N The shift register 51 includes the first to Nth column control signals Y1 to Y N is input serially to generate the n-th column control signal Y n Flip Flop 52 n Flip-flop 52 n is the n-th column control signal Y output from the shift register 51. n and the latched n-th column control signal Y n The nth column control line 33 n Output to.

[0038] Flip Flop 52 n is preferably an RS flip-flop. In this case, flip-flop 52 nWhen the latch is on, the n-th column control signal Y n The nth column control line 33 n The flip-flop 52 n When set is on, a logic value of 1 is sent to the n-th column control line 33 n By outputting to pixel P m,n Also, flip-flop 52 can be reset. n When reset is on, a logic value of 0 is sent to the n-th column control line 33. n By outputting to pixel P m,n can be turned off.

[0039] In this circuit configuration example, the column control unit 31 includes a shift register 51 and flip-flops 521 to 52 N If it contains, flip-flop 52 n to the n-th column control signal Y n The nth column control line 33 n While outputting the next first to Nth column control signals Y1 to Y N can be input serially.

[0040] The row control unit 21 may have a similar configuration to the column control unit 31. The row control unit 21 and the column control unit 31 may each be provided with a shift register, or only one shift register may be provided in each of the row control unit 21 and the column control unit 31.

[0041] Next, pixel P m,n An example of the circuit configuration of pixel P m,n includes one or more photodiodes that generate charges in response to light reception, and receives the m-th row control signal X m and the n-th column control signal Y n Based on each logic value, the charge generated in the photodiode is transferred to the m-th row output line 24 m or nth column output line 34 n The circuit for making this selection can be configured in a variety of ways.

[0042] FIG. 6 shows pixel Pm,n FIG. 1 is a diagram showing an example of a circuit configuration of a pixel P m,n includes a photodiode PD1, a photodiode PD2, a switch SW1, a switch SW2, a logical product circuit AND1, and a logical product circuit AND2. The switches SW1 and SW2 may be configured using MOS transistors.

[0043] The logical product circuit AND1 receives the m-th row control signal X m and the n-th column control signal Y n If both signals have a logical value of 1, the switch SW1 is turned on, otherwise the switch SW1 is turned off. The switch SW1 is connected to the photodiode PD1 and the n-th column output line 34. n When the photodiode is in an on state, the charge generated in the photodiode PD1 is transferred to the n-th column output line 34. n Output to.

[0044] The logical product circuit AND2 receives the m-th row control signal X m and the n-th column control signal Y n If both signals have a logical value of 1, the switch SW2 is turned on, otherwise the switch SW2 is turned off. The switch SW2 is connected to the photodiode PD2 and the m-th row output line 24. m When the photodiode PD2 is in the on state, the charge generated in the photodiode PD2 is transferred to the m-th row output line 24 m Output to.

[0045] FIG. 7 shows pixel P m,n FIG. 7 is a diagram showing an example of charge output of each pixel in the pixel array section 10 when the circuit configuration example of FIG. 6 is used. In this diagram, each rectangular area of ​​8 rows and 8 columns represents a pixel. Among them, the pixel shown by hatching outputs a charge generated in the photodiode PD1 to the n-th column output line 34. n , and the charge generated in the photodiode PD2 is output to the m-th row output line 24 m The other pixels are output to the m-th row output line 24 m and the n-th column output line 34 n The charge is not output to either of the above.

[0046] FIG. 8 shows pixel P m,n FIG. 1 is a diagram showing another example of the circuit configuration of the pixel P m,n includes a photodiode PD, a switch SW1, a switch SW2, a logical AND circuit AND1, a logical AND circuit AND2, and a logical inversion circuit INV.

[0047] The logical product circuit AND1 receives the m-th row control signal X m and the n-th column control signal Y n If both signals have a logical value of 1, the switch SW1 is turned on, otherwise the switch SW1 is turned off. The switch SW1 is connected to the photodiode PD and the n-th column output line 34. n When the photodiode is in an on state, the charge generated in the photodiode PD is transferred to the n-th column output line 34 n Output to.

[0048] The logic inversion circuit INV outputs the n-th column control signal Y n This n-th column control signal Y n The inverted signal is output to the AND circuit AND2.

[0049] The logical product circuit AND2 receives the m-th row control signal X m and the output signal of the logic inversion circuit INV, and if both signals have a logical value of 1, the switch SW2 is turned on, otherwise the switch SW2 is turned off. m is a logical value of 1 and the n-th column control signal Y n If the logical value of is 0, the switch SW2 is turned on. The switch SW2 is connected to the photodiode PD and the m-th row output line 24 m When the photodiode is in an on state, the charge generated in the photodiode PD is transferred to the m-th row output line 24 m Output to.

[0050] In this circuit configuration example, the switches SW1 and SW2 are not turned on at the same time, so that the pixel P m,n8 can have a larger area of ​​the light sensitive region of each photodiode than the example of the configuration shown in Fig. 6.

[0051] FIG. 9 shows pixel P m,n FIG. 9 is a diagram showing an example of charge output of each pixel in the pixel array section 10 when the circuit configuration example of FIG. 8 is used. In this diagram, each rectangular area of ​​8 rows and 8 columns indicates a pixel. Among them, the pixel shown with the first type of hatching outputs a charge generated in the photodiode PD to the n-th column output line 34. n The pixels indicated by the second type of hatching output charges generated in the photodiodes PD to the m-th row output line 24. m The other pixels are output to the m-th row output line 24 m and the n-th column output line 34 n The charge is not output to either of the above.

[0052] FIG. 10 shows pixel P m,n FIG. 1 is a diagram showing another example of the circuit configuration of the pixel P m,n includes a photodiode PD, a switch SW1, a switch SW2, a logical product circuit AND1, a logical product circuit AND2, a logical inversion circuit INV1, and a logical inversion circuit INV2.

[0053] The logic inversion circuit INV1 outputs the m-th row control signal X m This m-th row control signal X m The inverted signal is output to the AND circuit AND1.

[0054] The AND circuit AND1 receives the output signal of the logic inverter INV1 and the n-th column control signal Y n If both signals have a logical value of 1, the switch SW1 is turned on, otherwise the switch SW1 is turned off. m is a logical value of 0 and the n-th column control signal Y n If the logical value of is 1, the switch SW1 is turned on. The switch SW1 is connected between the photodiode PD and the n-th column output line 34 nWhen the photodiode is in an on state, the charge generated in the photodiode PD is transferred to the n-th column output line 34 n Output to.

[0055] The logic inversion circuit INV2 outputs the n-th column control signal Y n This n-th column control signal Y n The inverted signal is output to the AND circuit AND2.

[0056] The logical product circuit AND2 receives the m-th row control signal X m and the output signal of the logic inversion circuit INV2, and if both signals have a logical value of 1, the switch SW2 is turned on, otherwise the switch SW2 is turned off. m is a logical value of 1 and the n-th column control signal Y n If the logical value of is 0, the switch SW2 is turned on. The switch SW2 is connected to the photodiode PD and the m-th row output line 24 m When the photodiode is in an on state, the charge generated in the photodiode PD is transferred to the m-th row output line 24 m Output to.

[0057] In this circuit configuration example, the switches SW1 and SW2 are not turned on at the same time, so the pixel P m,n 10 can have a larger area of ​​the light sensitive region of each photodiode than the example of the configuration shown in Fig. 6.

[0058] FIG. 11 shows pixel P m,n FIG. 11 is a diagram showing an example of charge output of each pixel in the pixel array section 10 when the circuit configuration example of FIG. 10 is used. In this diagram, each rectangular area of ​​8 rows and 8 columns represents a pixel. Among these, the pixel shown with the first type of hatching outputs a charge generated in the photodiode PD to the n-th column output line 34. n The pixels indicated by the second type of hatching output charges generated in the photodiodes PD to the m-th row output line 24. mThe other pixels are output to the m-th row output line 24 m and the n-th column output line 34 n The charge is not output to either of the above.

[0059] FIG. 12 shows pixel P m,n FIG. 1 is a diagram showing another example of the circuit configuration of the pixel P m,n includes a photodiode PD, a switch SW1, a switch SW2, a logical AND circuit AND1, and a logical AND circuit AND2.

[0060] N pixels P in the mth row m,1 ~P m,N For the m-th row control signal X m A logic inversion circuit INV1 is provided to output a signal obtained by inverting the logic of the m-th row control signal X m In addition to the row control line which provides the output signal of the logic inverter INV1, another row control line is provided which provides the output signal of the logic inverter INV2.

[0061] M pixels P in the nth column 1,n ~P M,n For the n-th column control signal Y n A logic inversion circuit INV2 is provided to output a signal obtained by inverting the logic of the n-th column control signal Y n In addition to the column control line which provides the output signal of the logic inverter INV2, another column control line is provided which provides the output signal of the logic inverter INV3.

[0062] The operation of the switches SW1 and SW2 in this circuit configuration example is the same as that in the configuration example shown in Figure 10. In this circuit configuration example, the switches SW1 and SW2 are not turned on at the same time, so that the pixel P m,n 12 , the area of ​​the light-sensitive region of each photodiode can be made larger than that of the configuration example shown in FIG. 6 . Also, in the configuration example shown in FIG. 12 , the area of ​​the light-sensitive region of each photodiode can be made larger than that of the configuration example shown in FIG. 10 . m,n Since the logic inversion circuit is not included, the area of ​​the light-sensitive region of the photodiode can be further increased.

[0063] FIG. 13 shows pixel Pm,n FIG. 1 is a diagram showing another example of the circuit configuration of the pixel P m,n includes photodiodes PD1 and PD2 and NMOS transistors M1 to M4. The NMOS transistors M1 to M4 act as switches.

[0064] The NMOS transistors M1 and M3 are connected to the n-th column control signal Y n is in the on state when the logical value is 1, and the n-th column control signal Y n is turned off when the logical value is 0. The NMOS transistors M2 and M4 are connected to the m-th row control signal X m is in the on state if the logical value is 1, and the m-th row control signal X m If the logical value is 0, the switch is in the off state.

[0065] The NMOS transistors M1 and M2 are connected to the photodiode PD1 and the n-th column output line 34 n When both are in the ON state, the charge generated in the photodiode PD1 is transferred to the n-th column output line 34 n The NMOS transistors M3 and M4 are connected to the photodiode PD2 and the m-th row output line 24. m When both are in the on state, the charge generated in the photodiode PD2 is transferred to the m-th row output line 24 m Output to.

[0066] Pixel P m,n An example of charge output of each pixel in the pixel array section 10 when the circuit configuration example of FIG. 13 is used is similar to that of FIG.

[0067] FIG. 14 shows pixel P m,n FIG. 1 is a diagram showing another example of the circuit configuration of the pixel P m,n includes a photodiode PD and NMOS transistors M1 to M4. The NMOS transistors M1 to M4 act as switches.

[0068] N pixels P in the mth row m,1 ~P m,N For the m-th row control signal X mA logic inversion circuit INV1 is provided to output a signal obtained by inverting the logic of the m-th row control signal X m In addition to the row control line which provides the output signal of the logic inverter INV1, another row control line is provided which provides the output signal of the logic inverter INV2.

[0069] M pixels P in the nth column 1,n ~P M,n For the n-th column control signal Y n A logic inversion circuit INV2 is provided to output a signal obtained by inverting the logic of the n-th column control signal Y n In addition to the column control line which provides the output signal of the logic inverter INV2, another column control line is provided which provides the output signal of the logic inverter INV3.

[0070] The NMOS transistor M1 receives the n-th column control signal Y n The NMOS transistor M2 inputs the output signal of the logic inverting circuit INV1 to its gate. The NMOS transistors M1 and M2 are connected to the photodiode PD and the n-th column output line 34. n The m-th row control signal X m is a logical value of 0 and the n-th column control signal Y n When the logic value is 1, the charge generated in the photodiode PD is input to the n-th column output line 34 n Output to.

[0071] The NMOS transistor M3 inputs the output signal of the logic inverting circuit INV2 to its gate. The NMOS transistor M4 inputs the m-th row control signal X m The NMOS transistors M3 and M4 are connected to the photodiode PD and the m-th row output line 24. m The m-th row control signal X m is a logical value of 1 and the n-th column control signal Y n When the logical value of is 0, the charge generated in the photodiode PD is input to the m-th row output line 24 m Output to.

[0072] Pixel P m,n An example of charge output of each pixel in the pixel array section 10 when the circuit configuration example of FIG. 14 is used is similar to that of FIG.

[0073] The pixel P that we have explained so far m,n In the case where the above circuit configuration example is adopted, examples of charge output of each pixel in the pixel array section 10 are shown in FIGS. 7, 9, and 11. In these examples of charge output, m and the n-th column output line 34 n However, as will be described next, before resetting each pixel, the row control unit 21 outputs the first to Mth row control signals X1 to X M Alternatively, the column control unit 31 outputs the first to Nth column control signals Y1 to Y N By outputting a signal obtained by logically inverting the first row control signal X1 to the Mth row control signal X2, the charges can be efficiently output from all the pixels. M or the first to Nth column control signals Y1 to Y N Since it is only necessary to logically invert the above, it is possible to save capacity for storing patterns used in the compressed sensing technology.

[0074] 15 to 18 show pixel P m,n 7 is a diagram showing an example of charge output of each pixel in the pixel array section 10 when the circuit configuration example of FIG. 6 is used. For example, in a first period, the row control section 21 outputs first to M-th row control signals X1 to X M The column control unit 31 outputs [10101101] as the first to Nth column control signals Y1 to Y N 15. The pixels that output charges in the pixel array section 10 during this first period are the pixels indicated by hatching in FIG.

[0075] In a second period following the first period, the row control unit 21 outputs the first to Mth row control signals X1 to X M The column control unit 31 outputs the first to Nth column control signals Y1 to Y N 16, the pixel array section 10 outputs [01001101], which is the logical inversion of [10110010] from the previous period. The pixels that output charges in the pixel array section 10 during this second period are the pixels indicated by hatching in FIG.

[0076] In a third period following the second period, the row control unit 21 outputs the first to Mth row control signals X1 to X M The column control unit 31 outputs the first to Nth column control signals Y1 to Y N 17. The pixels in the pixel array section 10 that output charges during this third period are the pixels indicated by hatching in FIG.

[0077] In a fourth period following the third period, the row control unit 21 outputs the first to Mth row control signals X1 to X M The column control unit 31 outputs the first to Nth column control signals Y1 to Y N 18, the pixel array section 10 outputs [10110010], which is the logical inversion of [01001101] from the previous period. The pixels that output charges in the pixel array section 10 during this fourth period are the pixels indicated by hatching in FIG.

[0078] In this way, charges can be output from all pixels over the first to fourth periods. In this case, various timings from exposure to readout are possible. Figures 19 to 22 are diagrams showing examples of timings from exposure to readout when charges are output from all pixels as described in Figures 15 to 18.

[0079] In the example of the timing shown in FIG. 19, all pixels start exposure at the same time, and in the first period after a certain period has elapsed, charges are output from the pixels shown in hatching in FIG. 16, in the second period, charges are output from the pixels shown in hatching in FIG. 17, in the third period, and charges are output from the pixels shown in hatching in FIG. 19, in the fourth period. The exposure time differs depending on which of the first to fourth periods the charges are output in, but the difference in exposure time can be easily corrected when solving an optimization problem using compressed sensing technology. This timing example can be applied to the circuit configuration example of the column readout unit 32 shown in FIG. 2 and the similar circuit configuration example of the row readout unit 22.

[0080] In the example of the timing shown in Fig. 20, the exposure time of all pixels is made constant by resetting each pixel at an appropriate timing. Charges are transferred from the pixels shown with hatching in Fig. 16 to the row readout section 22 or the column readout section 32, and then digital values ​​according to the amount of charge are output from the row readout section 22 or the column readout section 32. When the charge transfer for these pixels is completed, charges are transferred from the pixels shown with hatching in Fig. 17 to the row readout section 22 or the column readout section 32, and then digital values ​​according to the amount of charge are output from the row readout section 22 or the column readout section 32.

[0081] 18 to the row readout section 22 or the column readout section 32, and then a digital value according to the amount of charge is output from the row readout section 22 or the column readout section 32. When charge transfer is completed for these pixels, charge is transferred from the hatched pixels in Fig. 19 to the row readout section 22 or the column readout section 32, and then a digital value according to the amount of charge is output from the row readout section 22 or the column readout section 32.

[0082] 4 and a similar circuit configuration example of the row readout section 22. In this case, two capacitors are provided for each row in the row readout section 22, and two capacitors are provided for each column in the column readout section 32, so that the transfer of charge from a pixel to one capacitor and the transfer of charge from the other capacitor to the conversion section 49 can be performed in parallel.

[0083] In the example of the timing shown in Fig. 21, the exposure time of all pixels is made constant by resetting each pixel at an appropriate timing. After resetting and exposure for a certain period of time in the pixels shown with hatching in Fig. 16, charges are transferred from these pixels to the row readout section 22 or the column readout section 32, and then digital values ​​according to the amount of charge are output from the row readout section 22 or the column readout section 32. When the charge transfer for these pixels is completed, after resetting and exposure for a certain period of time in the pixels shown with hatching in Fig. 17, charges are transferred from these pixels to the row readout section 22 or the column readout section 32, and then digital values ​​according to the amount of charge are output from the row readout section 22 or the column readout section 32.

[0084] 18, after resetting and exposure for a certain period of time, the charges are transferred from these pixels to the row readout section 22 or the column readout section 32, and then a digital value according to the amount of charge is output from the row readout section 22 or the column readout section 32. When the charge transfer for these pixels is completed, the pixels shown by hatching in Fig. 19, after resetting and exposure for a certain period of time, the charges are transferred from these pixels to the row readout section 22 or the column readout section 32, and then a digital value according to the amount of charge is output from the row readout section 22 or the column readout section 32.

[0085] This timing aspect can be applied to the circuit configuration example of the column readout section 32 shown in Fig. 3 and the similar circuit configuration example of the row readout section 22. In this case, one capacitor is provided for each row in the row readout section 22, and one capacitor is provided for each column in the column readout section 32, so that the aspect can be applied regardless of the readout time and the exposure time.

[0086] In the example of the timing shown in FIG. 22, the exposure time of all pixels is made constant by resetting each pixel at an appropriate timing. For the pixels shown hatched in FIG. 16, digital values ​​according to the amount of charge are output from the row readout section 22 or the column readout section 32. When the readout is completed for these pixels, digital values ​​according to the amount of charge are output from the row readout section 22 or the column readout section 32 for the pixels shown hatched in FIG. 17. When the readout is completed for these pixels, digital values ​​according to the amount of charge are output from the row readout section 22 or the column readout section 32 for the pixels shown hatched in FIG. 18. When the readout is completed for these pixels, digital values ​​according to the amount of charge are output from the row readout section 22 or the column readout section 32 for the pixels shown hatched in FIG. 19. This timing example is applicable to the circuit configuration example of the column readout section 32 shown in FIG. 2 and the similar circuit configuration example of the row readout section 22. It is applicable when the readout time is 1 / 3 or less of the exposure time.

[0087] 23 and 24 show pixel P m,n 10 or 12. For example, in a first period, the row control unit 21 outputs first to M-th row control signals X1 to X M The column control unit 31 outputs [10101101] as the first to Nth column control signals Y1 to Y N 23. The pixels that output charges in the pixel array section 10 during this first period are the pixels shown by hatching in FIG. 23. The pixels shown by the first type of hatching among them output charges generated in the photodiode PD to the n-th column output line 34. nThe pixels indicated by the second type of hatching output charges generated in the photodiodes PD to the m-th row output line 24. m The other pixels are output to the m-th row output line 24 m and the n-th column output line 34 n The charge is not output to either of the above.

[0088] In a second period following the first period, the row control unit 21 outputs the first to Mth row control signals X1 to X M The column control unit 31 outputs the first to Nth column control signals Y1 to Y N 24. The pixels in the pixel array section 10 that output charges during this second period are the pixels shown by hatching in FIG. 24. The pixels shown by the first type of hatching among them output charges generated in the photodiode PD to the n-th column output line 34. n The pixels indicated by the second type of hatching output charges generated in the photodiodes PD to the m-th row output line 24. m The other pixels are output to the m-th row output line 24 m and the n-th column output line 34 n The charge is not output to either of the above.

[0089] In this way, charges can be output from all pixels over the first and second periods. In this case, various timings from exposure to readout are possible. Figures 25 to 28 are diagrams showing examples of timings from exposure to readout when charges are output from all pixels as described in Figures 23 and 24.

[0090] In the example of the timing shown in Fig. 25, all pixels start exposure at the same time, and charges are output from the pixels shown by hatching in Fig. 23 in a first period after a certain period has elapsed, and charges are output from the pixels shown by hatching in Fig. 24 in a second period. The exposure time differs depending on whether the charges are output in the first or second period, but the difference in exposure time can be easily corrected when solving an optimization problem using compressed sensing technology. This timing example can be applied to the circuit configuration example of the column readout unit 32 shown in Fig. 2 and the similar circuit configuration example of the row readout unit 22.

[0091] In the example of the timing shown in Fig. 26, the exposure time of all pixels is made constant by resetting each pixel at an appropriate timing. Charges are transferred from the pixels shown with hatching in Fig. 23 to the row readout section 22 or the column readout section 32, and then digital values ​​according to the amount of charge are output from the row readout section 22 or the column readout section 32. When the charge transfer for these pixels is completed, charges are transferred from the pixels shown with hatching in Fig. 24 to the row readout section 22 or the column readout section 32, and then digital values ​​according to the amount of charge are output from the row readout section 22 or the column readout section 32.

[0092] 4 and a similar circuit configuration example of the row readout section 22. In this case, two capacitors are provided for each row in the row readout section 22, and two capacitors are provided for each column in the column readout section 32, so that the transfer of charge from a pixel to one capacitor and the transfer of charge from the other capacitor to the conversion section 49 can be performed in parallel.

[0093] In the example of the timing shown in Fig. 27, the exposure time of all pixels is made constant by resetting each pixel at an appropriate timing. After resetting and exposure for a certain period of time in the pixels shown with hatching in Fig. 23, charges are transferred from these pixels to the row readout section 22 or the column readout section 32, and then digital values ​​according to the amount of charge are output from the row readout section 22 or the column readout section 32. When the charge transfer for these pixels is completed, after resetting and exposure for a certain period of time in the pixels shown with hatching in Fig. 24, charges are transferred from these pixels to the row readout section 22 or the column readout section 32, and then digital values ​​according to the amount of charge are output from the row readout section 22 or the column readout section 32.

[0094] This timing aspect can be applied to the circuit configuration example of the column readout section 32 shown in Fig. 3 and the similar circuit configuration example of the row readout section 22. In this case, one capacitor is provided for each row in the row readout section 22, and one capacitor is provided for each column in the column readout section 32, so that the aspect can be applied regardless of the readout time and the exposure time.

[0095] In the example of the timing shown in Fig. 28, the exposure time of all pixels is made constant by resetting each pixel at an appropriate timing. For the pixels shown hatched in Fig. 23, digital values ​​corresponding to the amount of charge are output from the row readout section 22 or the column readout section 32. When readout for these pixels is completed, for the pixels shown hatched in Fig. 24, digital values ​​corresponding to the amount of charge are output from the row readout section 22 or the column readout section 32. This timing example is applicable to the circuit configuration example of the column readout section 32 shown in Fig. 2 and a similar circuit configuration example of the row readout section 22. It is applicable when the readout time is equal to or shorter than the exposure time.

[0096] In the embodiments described above with reference to FIGS. 15 to 28, the first to Mth row control signals X1 to X M or the first to Nth column control signals Y1 to Y NBy logically inverting the above, it was possible to efficiently output charges from all pixels. m,n In the circuit configuration example, a set of first to Mth row control signals X1 to X M and the first to Nth column control signals Y1 to Y N By using this, it is possible to efficiently output charges from all pixels.

[0097] FIG. 29 shows pixel P m,n FIG. 1 is a diagram showing another example of the circuit configuration of the pixel P m,n includes a photodiode PD, switches SW1 to SW4, and AND circuits AND1 to AND4.

[0098] N pixels P in the mth row m,1 ~P m,N For the m-th row control signal X m A logic inversion circuit INV1 is provided to output a signal obtained by inverting the logic of the m-th row control signal X m In addition to the row control line that supplies the output signal of the logic inverter INV1, a row control line is provided that supplies the output signal of the logic inverter INV2. m,1 ~P m,N For the m-th row output line 24 m As line output line 24 m,1 and row output line 24 m,2 is provided.

[0099] M pixels P in the nth column 1,n ~P M,n For the n-th column control signal Y n A logic inversion circuit INV2 is provided to output a signal obtained by inverting the logic of the n-th column control signal Y n In addition to the column control line that supplies the output signal of the logic inversion circuit INV2, a column control line is provided that supplies the output signal of the logic inversion circuit INV3. 1,n ~P M,n For the n-th column output line 34 n As column output line 34 n,1 and column output line 34 n,2 is provided.

[0100] The AND circuit AND1 receives the output signal of the logic inverter INV1 and the n-th column control signal Y n If both signals have a logical value of 1, the switch SW1 is turned on, otherwise the switch SW1 is turned off. m is a logical value of 0 and the n-th column control signal Y n If the logical value of is 1, the switch SW1 is turned on. The switch SW1 connects the photodiode PD and the column output line 34 n,1 When the photodiode PD is in an on state, the charge generated in the photodiode PD is transferred to the column output line 34. n,1 Output to.

[0101] The logical product circuit AND2 receives the m-th row control signal X m and the output signal of the logic inversion circuit INV2, and if both signals have a logical value of 1, the switch SW2 is turned on, otherwise the switch SW2 is turned off. m is a logical value of 1 and the n-th column control signal Y n If the logical value of is 0, the switch SW2 is turned on. The switch SW2 is connected between the photodiode PD and the row output line 24 m,1 When the photodiode is in an on state, the charge generated in the photodiode PD is transferred to the row output line 24 m,1 Output to.

[0102] The logical product circuit AND3 outputs the m-th row control signal X m and the n-th column control signal Y n If both signals have a logical value of 1, the switch SW3 is turned on, otherwise the switch SW3 is turned off. m and the n-th column control signal Y n If both of these are logic values ​​1, the switch SW3 is turned on. The switch SW3 is connected to the photodiode PD and the row output line 24. m,2 When the photodiode is in an on state, the charge generated in the photodiode PD is transferred to the row output line 24 m,2 Output to.

[0103] The AND circuit AND4 receives the output signal of the logic inverter INV1 and the output signal of the logic inverter INV2, and if both signals have a logical value of 1, turns on the switch SW4, otherwise turns off the switch SW4. That is, the AND circuit AND4 receives the m-th row control signal X m and the n-th column control signal Y n If both of these are logic 0, the switch SW4 is turned on. The switch SW4 is connected to the photodiode PD and the column output line 34. n,2 When the photodiode PD is in an on state, the charge generated in the photodiode PD is transferred to the column output line 34. n,2 Output to.

[0104] FIG. 30 shows pixel P m,n FIG. 30 is a diagram showing an example of charge output of each pixel in the pixel array section 10 when the circuit configuration example of FIG. 29 is used. In this diagram, each rectangular area of ​​8 rows and 8 columns represents a pixel. Among these, the pixel shown with the first type of hatching outputs a charge generated in the photodiode PD to the column output line 34. n,1 The pixels indicated by the second type of hatching output the charge generated in the photodiode PD to the row output line 24. m,1 The pixels indicated by the third type of hatching output the charge generated in the photodiode PD to the row output line 24. m,2 The pixels indicated by the fourth type of hatching output the charge generated in the photodiode PD to the column output line 34. n,2 In this manner, charges can be output from all pixels.

[0105] FIG. 31 shows pixel P m,n FIG. 1 is a diagram showing another example of the circuit configuration of the pixel P m,n includes a photodiode PD, switches SW1 and SW2, a logical product circuit AND, and a logical inversion circuit INV.

[0106] The logical product circuit AND receives the m-th row control signal X m and the n-th column control signal Y nIf both signals have a logical value of 1, the switch SW1 is turned on, otherwise the switch SW1 is turned off. The switch SW1 is connected to the photodiode PD and the n-th column output line 34. n When the photodiode is in an on state, the charge generated in the photodiode PD is transferred to the n-th column output line 34 n Output to.

[0107] The logic inversion circuit INV receives the output signal of the logical AND circuit AND, and turns on the switch SW2 if the output signal of the logical AND circuit AND is a logical value of 0, and turns off the switch SW2 if not. The switch SW2 is connected to the photodiode PD and the m-th row output line 24. m When the photodiode is in an on state, the charge generated in the photodiode PD is transferred to the m-th row output line 24 m Output to.

[0108] In this circuit configuration example, either one of the switches SW1 and SW2 is in an on state.

[0109] FIG. 32 shows pixel P m,n FIG. 1 is a diagram showing another example of the circuit configuration of the pixel P m,n includes a photodiode PD and NMOS transistors M1 to M4. The NMOS transistors M1 to M4 act as switches.

[0110] The NMOS transistor M1 receives the n-th column control signal Y n is in the on state when the logical value is 1, and the n-th column control signal Y n is turned off when the logical value is 0. m is in the on state if the logical value is 1, and the m-th row control signal X m is turned off when the logical value is 0. The NMOS transistors M1 and M2 are connected to the photodiode PD and the n-th column output line 34 n When both are in the ON state, the charge generated in the photodiode PD is transferred to the n-th column output line 34 n Output to.

[0111] The NMOS transistor M3 is connected to the n-th column control signal Y n is in the on state when the logical value is 0, and the n-th column control signal Y n is a logical value of 1, the NMOS transistor M4 is turned off. m is in the on state when the logical value is 0, and the m-th row control signal X m is turned off when the logical value is 1. The NMOS transistors M3 and M4 are connected to the photodiode PD and the m-th row output line 24 m When at least one of them is in an on state, the charge generated in the photodiode PD is transferred to the m-th row output line 24 m Output to.

[0112] In this circuit configuration example, either all of the NMOS transistors M1, M2 connected in series or all of the NMOS transistors M3, M4 connected in parallel are turned on.

[0113] FIG. 33 shows pixel P m,n 31 or 32. In this figure, each rectangular area of ​​8 rows and 8 columns represents a pixel. Among these, the pixel indicated by the first type of hatching outputs a charge generated in the photodiode PD to the column output line 34. n The pixels indicated by the second type of hatching output the charge generated in the photodiode PD to the row output line 24. m In this manner, charges can be output from all pixels.

[0114] FIG. 34 shows pixel P m,n FIG. 1 is a diagram showing another example of the circuit configuration of the pixel P m,n includes a photodiode PD, switches SW1 and SW2, an exclusive OR circuit XOR, and a NEGATIVE exclusive OR circuit NXOR.

[0115] The exclusive OR circuit XOR receives the m-th row control signal X m and the n-th column control signal Yn If the logical values ​​of the two signals are different from each other, the switch SW1 is turned on, otherwise the switch SW1 is turned off. The switch SW1 is connected to the photodiode PD and the n-th column output line 34. n When the photodiode is in an on state, the charge generated in the photodiode PD is transferred to the n-th column output line 34 n Output to.

[0116] The exclusive NOR circuit NXOR receives the m-th row control signal X m and the n-th column control signal Y n If the logical values ​​of the two signals are the same, the switch SW2 is turned on, otherwise the switch SW2 is turned off. The switch SW2 is connected to the photodiode PD and the m-th row output line 24 m When the photodiode is in an on state, the charge generated in the photodiode PD is transferred to the m-th row output line 24 m Output to.

[0117] In this circuit configuration example as well, either one of the switches SW1 and SW2 is in the on state.

[0118] FIG. 35 shows pixel P m,n FIG. 1 is a diagram showing another example of the circuit configuration of the pixel P m,n includes a photodiode PD and NMOS transistors M1 to M8. The NMOS transistors M1 to M8 act as switches.

[0119] The NMOS transistor M1 receives the n-th column control signal Y n is in the on state when the logical value is 1, and the n-th column control signal Y n is turned off when the logical value is 0. m is in the on state if the logical value is 1, and the m-th row control signal X m is turned off when the logical value is 0. The NMOS transistors M1 and M2 are connected to the photodiode PD and the n-th column output line 34 nWhen both are in the ON state, the charge generated in the photodiode PD is transferred to the n-th column output line 34 n Output to.

[0120] The NMOS transistor M3 is connected to the n-th column control signal Y n is in the on state when the logical value is 0, and the n-th column control signal Y n is a logical value of 1, the NMOS transistor M4 is turned off. m is in the on state when the logical value is 0, and the m-th row control signal X m is turned off when the logic value is 1. The NMOS transistors M3 and M4 are connected to the photodiode PD and the n-th column output line 34 n When both are in the ON state, the charge generated in the photodiode PD is transferred to the n-th column output line 34 n Output to.

[0121] The NMOS transistors M1 to M4 are connected to the m-th row control signal X m and the n-th column control signal Y n If the logical values ​​are the same, the charge generated in the photodiode PD is transferred to the n-th column output line 34 n Output to.

[0122] The NMOS transistor M5 is connected to the n-th column control signal Y n is in the on state when the logical value is 0, and the n-th column control signal Y n is a logical value of 1, the NMOS transistor M6 is turned off. m is in the on state if the logical value is 1, and the m-th row control signal X m When the logical value of is 0, the NMOS transistors M5 and M6 are connected to the photodiode PD and the m-th row output line 24. m When both are in the on state, the charge generated in the photodiode PD is transferred to the m-th row output line 24 m Output to.

[0123] The NMOS transistor M7 is connected to the n-th column control signal Y nis in the on state when the logical value is 1, and the n-th column control signal Y n is turned off when the logical value is 0. The NMOS transistor M8 is m is in the on state when the logical value is 0, and the m-th row control signal X m is turned off when the logical value is 1. The NMOS transistors M7 and M8 are connected to the photodiode PD and the m-th row output line 24 m When both are in the on state, the charge generated in the photodiode PD is transferred to the m-th row output line 24 m Output to.

[0124] The NMOS transistors M5 to M8 are connected to the m-th row control signal X m and the n-th column control signal Y n If the logical values ​​are different from each other, the charge generated in the photodiode PD is transferred to the m-th row output line 24 m Output to.

[0125] In this circuit configuration example, either all of the NMOS transistors M1 to M4 or all of the NMOS transistors M5 to M8 are in an ON state.

[0126] FIG. 36 shows pixel P m,n 34 or 35. In this figure, each rectangular area of ​​8 rows and 8 columns represents a pixel. Among these, the pixels indicated by the first type of hatching transmit the charge generated in the photodiode PD to the column output line 34. n The pixels indicated by the second type of hatching output the charge generated in the photodiode PD to the row output line 24. m In this manner, charges can be output from all pixels.

[0127] As described above, according to this embodiment, the pixel P m,n is the m-th row control signal X m and the n-th column control signal Y n Based on each logic value, the charge generated in the photodiode is transferred to the m-th row output line 24m or nth column output line 34 n The pixel array unit 10 selects whether to output the signal to the MN pixels P 1,1 ~P M,N Among them, the m-th row output line 24 m and the n-th column output line 34 n The pixels that output charges to the first to Mth row control signals X1 to X M and the first to Nth column control signals Y1 to Y N The first to Mth row control signals X1 to X M or the first to Nth column control signals Y1 to Y N By changing the pattern of the m-th row output line 24 m The pixels that output charges to the n-th column output line 34 can be changed. n It is possible to change the pixels that output charges to the input terminals. Therefore, this solid-state imaging device 1 does not need to use a spatial light modulator that was previously required when acquiring an image using the compressed sensing technology, so that increases in cost and power consumption are suppressed and the construction of an optical system is made easier. In other words, this solid-state imaging device 1 can easily acquire an image using the compressed sensing technology.

[0128] Moreover, an image cannot be reconstructed only from the data output from the row readout section 22 and the column readout section 32 of the solid-state imaging device 1. To reconstruct an image, the first to Mth row control signals X1 to X M and the first to Nth column control signals Y1 to Y N The following pattern is required. M and the first to Nth column control signals Y1 to Y N It can be said that the pattern is similar to a key in encrypted communication. That is, in the compressed sensing technology using the solid-state imaging device 1, even if the image is not encrypted, the data encrypted and compressed in the solid-state imaging device 1 can be transmitted to a server or the like connected via a network, so that the security of the data can be easily improved.

[0129] The present invention is not limited to the above embodiment, and various modifications are possible. For example, the pixel P m,n Each of the row control unit 21, the row readout unit 22, the column control unit 31, and the column readout unit 32 can have various circuit configuration examples. [Explanation of symbols]

[0130] 1... solid-state imaging device, 10... pixel array section, 21... row control section, 22... row readout section, 23 m …mth row control line, 24 m ...m-th row output line, 31...column control unit, 32...column readout unit, 33 n ...nth column control line, 34 n ...Nth column output line, 41 n ,42 n ,44 n ,45 n ,47 n ,48 n …NMOS transistor, 43 n ,46 n ...capacitor, 49...conversion unit, 51...shift register, 52 n …flip flop.

Claims

1. M, N pixels, each including a photodiode that generates an electric charge in response to receiving light, arranged two-dimensionally in M ​​rows and N columns (M and N are integers of 2 or more); a row control unit connected to N pixels in an m-th row (m is an integer between 1 and M) of the M rows and N columns by an m-th row control line, and providing an m-th row control signal to the N pixels in the m-th row via the m-th row control line; a row readout section connected to N pixels in an m-th row among the M rows and N columns by an m-th row output line, and inputting electric charges generated in the photodiodes of the N pixels in the m-th row and output to the m-th row output line; a column control unit connected to M pixels in an n-th column (n is an integer between 1 and N) of the M rows and N columns by an n-th column control line, and supplying an n-th column control signal to the M pixels in the n-th column via the n-th column control line; a column readout section connected to M pixels in an n-th column among the M rows and N columns by an n-th column output line, and inputting electric charges generated in the photodiodes of the M pixels in the n-th column and output to the n-th column output line; Equipped with A pixel in the mth row and the nth column among the MN pixels selects whether or not to output the charge generated in the photodiode to the mth row output line or the nth column output line based on the logical values ​​of the mth row control signal and the nth column control signal, Solid-state imaging device.

2. A plurality of m-th row control lines are provided. The solid-state imaging device according to claim 1 .

3. A plurality of n-th column control lines are provided.

3. The solid-state imaging device according to claim 1.

4. A plurality of m-th row output lines are provided.

4. The solid-state imaging device according to claim 1.

5. A plurality of n-th column output lines are provided.

5. The solid-state imaging device according to claim 1.

6. the row readout unit includes one or more capacitors that accumulate electric charges input via the m-th row output line; 6. The solid-state imaging device according to claim 1.

7. the row readout unit outputs a voltage value according to a total amount of charges input via all of the m-th row output lines.

7. The solid-state imaging device according to claim 1.

8. the row readout unit sequentially outputs voltage values ​​corresponding to amounts of charges input via the m-th row output line.

7. The solid-state imaging device according to claim 1.

9. the column readout unit includes one or more capacitors that accumulate electric charges input via an n-th column output line; The solid-state imaging device according to any one of claims 1 to 8.

10. the column readout unit outputs a voltage value according to a total amount of charges input via all of the n-th column output lines. The solid-state imaging device according to any one of claims 1 to 9.

11. the column readout unit sequentially outputs voltage values ​​corresponding to the amount of charge input via the n-th column output line; The solid-state imaging device according to any one of claims 1 to 9.

12. the row control unit includes a shift register that receives the first to M-th row control signals as serial data and outputs the m-th row control signal to an m-th row control line; The solid-state imaging device according to any one of claims 1 to 11.

13. the row control unit includes a flip-flop that latches the m-th row control signal output from the shift register and outputs the latched m-th row control signal to an m-th row control line; The solid-state imaging device according to claim 12.

14. the column control unit includes a shift register that receives first to N-th column control signals as serial data and outputs the n-th column control signal to an n-th column control line; The solid-state imaging device according to any one of claims 1 to 13.

15. the column control unit includes a flip-flop that latches an n-th column control signal output from the shift register and outputs the latched n-th column control signal to an n-th column control line; The solid-state imaging device according to claim 14.

16. The pixel in the mth row and the nth column includes, as the photodiode, a photodiode connected to the mth row output line and a photodiode connected to the nth column output line, separately. The solid-state imaging device according to any one of claims 1 to 15.

17. the pixel in the mth row and the nth column includes one photodiode, and when outputting a charge generated in the photodiode, outputs the charge to only one of the mth row output line and the nth column output line; The solid-state imaging device according to any one of claims 1 to 15.

Citation Information

Patent Citations

  • Solid-state imaging device

    JP2011250274A

  • Photodetection device and photodetection method

    JP2019161295A