Solid-state imaging element and imaging device
By incorporating a potential generation section to transfer signal charges between pixels, the solid-state image sensor effectively addresses the challenge of adding charges across multiple pixels, enhancing efficiency and reducing noise while allowing flexible pixel arrangements.
Patent Information
- Application Number
- JP2023071982
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2018-02-28
- Filing Date
- 2023-04-26
- Publication Date
- 2024-11-11
- Estimated Expiration
- 2039-01-17
AI Technical Summary
Existing solid-state image sensors face challenges in efficiently adding signal charges from multiple pixels, leading to noise and reduced conversion efficiency, particularly when arranging non-read and read pixels.
The implementation of a potential generation section in the pixel circuit, which applies a potential VPD to the first electrode of non-read pixels, allowing signal charges to transfer to read pixels, thereby adding charges without external accumulation sections, maintaining conversion efficiency, and reducing noise.
This approach enables the addition of signal charges from multiple pixels with reduced noise and increased freedom in arranging non-read and read pixels, allowing for high-speed readout and maintaining photoelectric conversion efficiency.
Smart Images

Figure 0007580523000001 
Figure 0007580523000002 
Figure 0007580523000003
Abstract
Description
[Technical field]
[0001] The present technology relates to a solid-state imaging element and an imaging device having a photoelectric conversion film provided across a plurality of pixels. [Background technology]
[0002] Solid-state imaging devices using compound semiconductors such as InGaAs for the photoelectric conversion film are being developed (see, for example, Patent Document 1). Signal charges generated in the photoelectric conversion film are sent to a pixel circuit for each pixel. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] International Publication No. 2017 / 150167 Summary of the Invention
[0004] In such a solid-state imaging device, it is desirable to be able to add up the signal charges of a plurality of pixels.
[0005] Therefore, it is desirable to provide a solid-state imaging element and an imaging device capable of adding signal charges of a plurality of pixels.
[0006] A solid-state imaging element according to one embodiment of the present disclosure includes a photoelectric conversion film provided across a plurality of pixels, a first electrode electrically connected to the photoelectric conversion film and provided for each pixel, a second electrode facing the first electrode with the photoelectric conversion film therebetween, a first charge storage section capable of storing signal charge generated in the photoelectric conversion film and transferred via the first electrode, a reset transistor provided for each pixel and capable of applying a reset potential to the first charge storage section, and a potential generation section electrically connected to the first electrodes of at least some of the plurality of pixels via the reset transistor and capable of generating a potential VPD different from the reset potential. The signal charges generated in the photoelectric conversion film of the pixel having the first electrode to which the potential VPD is applied move to the first charge accumulation section of the other pixels.
[0007] An imaging device according to an embodiment of the present disclosure includes the solid-state imaging element according to the embodiment of the present disclosure.
[0008] In the solid-state imaging element and imaging device according to the embodiment of the present disclosure, a potential generating section is provided, and therefore, during a period in which signal charges are accumulated in the first charge accumulating section, a potential VPD is applied to the first electrodes of at least some pixels (non-read pixels) of the plurality of pixels. The signal charges generated in the non-read pixels are transferred to the first electrodes of the pixels (read pixels) to which the potential VPD is not applied.
[0009] According to the solid-state imaging element and imaging device according to an embodiment of the present disclosure, since a potential generating unit is provided, the signal charge generated in the non-readout pixel is read out by the pixel circuit of the readout pixel together with the signal charge generated in the readout pixel. Therefore, the signal charges of a plurality of pixels can be added. Note that the effects described here are not necessarily limited, and any of the effects described in the present disclosure may be used. [Brief description of the drawings]
[0010] [Figure 1] 1 is a block diagram illustrating a schematic configuration of an imaging element according to a first embodiment of the present disclosure. [Diagram 2] 2 is a schematic plan view illustrating an example of a specific configuration of a pixel region illustrated in FIG. 1. [Diagram 3] 3 is a plan view showing an example of a control line connected to the readout pixels and the non-readout pixels shown in FIG. 2. [Figure 4] 3 is a diagram illustrating a schematic configuration of a photoelectric conversion unit and a pixel circuit of a readout pixel and a non-readout pixel illustrated in FIG. 2. [Diagram 5] 5 is a schematic diagram for explaining the operation of the readout pixel and the non-readout pixel shown in FIG. 4. [Figure 6] 5 is a timing chart for explaining a method of driving the pixel circuit shown in FIG. [Figure 7A] FIG. 13 is a diagram illustrating a schematic configuration of a pixel circuit of an image sensor (readout pixel) according to a second embodiment of the present disclosure. [Figure 7B]7B is a diagram illustrating a schematic configuration of a pixel circuit of a non-reading pixel of the image sensor illustrated in FIG. 7A. [Figure 8] 7A and 7B. FIG. 8 is a timing chart for explaining a method of driving the pixel circuit shown in FIG. [Figure 9] FIG. 7B is a diagram illustrating a schematic diagram of another example (variation 1) of the pixel circuit shown in FIG. 7A. [Figure 10] FIG. 7C is a diagram illustrating a schematic diagram of another example (modification 2) of the pixel circuit shown in FIGS. 7A and 7B. [Figure 11A] FIG. 13 is a diagram illustrating a schematic configuration of a pixel circuit of an image sensor (readout pixel) according to a third embodiment of the present disclosure. [Figure 11B] 11B is a diagram illustrating a schematic configuration of a pixel circuit of a non-reading pixel of the image sensor illustrated in FIG. 11A. [Figure 12] 11A and 11B. FIG. 11B is a timing chart for explaining a method of driving the pixel circuit shown in FIG. [Figure 13] FIG. 14 is a diagram illustrating a schematic diagram of another example of the pixel circuit shown in FIGS. 11A and 11B. [Figure 14A] FIG. 13 is a diagram illustrating a schematic configuration of a pixel circuit of an image sensor (readout pixel) according to a fourth embodiment of the present disclosure. [Figure 14B] 14B is a diagram illustrating a schematic configuration of a pixel circuit of a non-reading pixel of the image sensor illustrated in FIG. 14A. [Figure 15] 14A and 14B. FIG. 14B is a timing chart for explaining a method of driving the pixel circuit shown in FIG. [Figure 16A] 3 is a plan view showing another example (1) of the arrangement of readout pixels and non-readout pixels shown in FIG. 2. FIG. [Figure 16B] 3 is a schematic plan view showing another example (2) of the arrangement of readout pixels and non-readout pixels shown in FIG. 2. FIG. [Figure 17] 3 is a plan view showing another example (3) of the arrangement of readout pixels and non-readout pixels shown in FIG. 2. FIG. [Figure 18] 18 is a schematic plan view illustrating an example of control lines connected to the readout pixels and the non-readout pixels illustrated in FIG. 17. [Figure 19]5 is a diagram illustrating another example of the configuration of the pixel circuit shown in FIG. 4. FIG. [Figure 20] FIG. 7C is a diagram illustrating another example of the configuration of the pixel circuit shown in FIGS. 7A and 7B. [Figure 21A] 3 is a schematic plan view showing another example (4) of the arrangement of readout pixels and non-readout pixels shown in FIG. 2. FIG. [Figure 21B] 3 is a schematic plan view showing another example (5) of the arrangement of readout pixels and non-readout pixels shown in FIG. 2. FIG. [Figure 22] 2 is a functional block diagram illustrating an example of an imaging device (electronic device) using the imaging element shown in FIG. 1 etc. [Figure 23] 1 is a block diagram showing an example of a schematic configuration of an in-vivo information acquiring system. [Figure 24] 1 is a diagram illustrating an example of a schematic configuration of an endoscopic surgery system. [Diagram 25] 2 is a block diagram showing an example of a functional configuration of a camera head and a CCU. FIG. [Figure 26] 1 is a block diagram showing an example of a schematic configuration of a vehicle control system; [Figure 27] 4 is an explanatory diagram showing an example of the installation positions of an outside-vehicle information detection unit and an imaging unit; FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011] Hereinafter, embodiments of the present technology will be described in detail with reference to the drawings. The description will be made in the following order. 1. First embodiment (example of a solid-state imaging device having a potential generating unit connected in series to a reset transistor) 2. Second embodiment (example of solid-state imaging device having a potential generating unit connected in parallel to a reset transistor) 3. Modification 1 (Example with Transistor for Capacitance Switching) 4. Modification 2 (Example with Global Shutter Function) 5. Third embodiment (example of solid-state imaging device having a potential generating unit connected in series to a first charge storage unit (FD)) 6. Fourth embodiment (example of solid-state imaging device having a potential generating unit including a transfer transistor and a second charge storage unit) 7. Modification 3 (Example of Arrangement of Readout Pixels and Non-Readout Pixels) 8. Application Examples (Electronic Devices) 9. Application Examples
[0012] <1. First embodiment> [Configuration of image sensor 1] 1 is a schematic diagram showing an example of a functional configuration of a solid-state imaging element (imaging element 1) according to an embodiment of the present disclosure. The imaging element 1 is, for example, an infrared image sensor, and is sensitive to light with a wavelength of, for example, 800 nm or more. The imaging element 1 is provided with, for example, a rectangular pixel region 10P and an extra-pixel region 10B outside the pixel region 10P. The extra-pixel region 10B is provided with a peripheral circuit for driving the pixel region 10P.
[0013] A plurality of light receiving unit areas (pixels P) arranged, for example, two-dimensionally are provided in the pixel area 10P of the image sensor 1. The peripheral circuits provided in the extra-pixel area 10B include, for example, a row scanning unit 201, a horizontal selection unit 203, a column scanning unit 204, and a system control unit 202.
[0014] 2 shows a more specific configuration of the pixel region 10P. The pixels P provided in the pixel region 10P include a readout pixel Pr and a non-readout pixel Pn. The readout pixel Pr and the non-readout pixel Pn are provided, for example, for each pixel row, and the rows in which the readout pixels Pr are arranged and the rows in which the non-readout pixels Pn are arranged are arranged alternately. As will be described later, the signal charge generated in the non-readout pixel Pn is read out by the pixel circuit (a pixel circuit 20Pr described later) of the adjacent readout pixel Pr arranged in the same pixel column. That is, in the example shown in FIG. 2, the signal charges of two pixels P are added together.
[0015] 3 shows the control lines Lps for selecting the readout pixels Pr and the non-readout pixels Pn. The control lines Lps extend, for example, along the row direction (X direction in FIG. 3) for each pixel row. In other words, the control lines Lps are wired to the pixels P (readout pixels Pr, non-readout pixels Pn) for each pixel row.
[0016] In addition, in the pixels P, for example, pixel drive lines Lread (for example, row selection lines and reset control lines) are wired for each pixel row, and vertical signal lines Lsig are wired for each pixel column (FIG. 1). The pixel drive lines Lread transmit drive signals for reading out signals from the pixels P. One end of the pixel drive lines Lread is connected to an output terminal of the row scanning unit 201 corresponding to each row.
[0017] The row scanning unit 201 is a pixel driving unit that is configured with a shift register, an address decoder, etc., and drives each pixel P in the pixel region 10P, for example, on a row-by-row basis. Signals output from each pixel P in a pixel row selected and scanned by the row scanning unit 201 are supplied to a horizontal selection unit 203 through each vertical signal line Lsig. The horizontal selection unit 203 is configured with an amplifier, a horizontal selection switch, etc., provided for each vertical signal line Lsig.
[0018] The column scanning unit 204 is composed of a shift register, an address decoder, etc., and sequentially drives while scanning each horizontal selection switch of the horizontal selection unit 203. By the selective scanning by this column scanning unit 204, the signals of each pixel transmitted through each vertical signal line Lsig are sequentially output to a horizontal signal line 205, and input to a signal processing unit (not shown) etc. through the horizontal signal line 205.
[0019] The system control unit 202 receives an externally applied clock, data instructing an operation mode, and the like, and also outputs data such as internal information of the image sensor 1. The system control unit 202 further has a timing generator that generates various timing signals, and performs drive control of the row scanning unit 201, horizontal selection unit 203, column scanning unit 204, and the like based on the various timing signals generated by the timing generator.
[0020] The specific configurations of the readout pixels Pr and non-readout pixels Pn of the image sensor 1 will be described below.
[0021] 4 shows a schematic cross-sectional configuration of a pixel region 10P of the image sensor 1 together with pixel circuits 20Pr, 20Pn of the readout pixel Pr and the non-readout pixel Pn. The image sensor 1 has a laminated structure of, for example, a semiconductor substrate having a photoelectric conversion unit 10 and a circuit substrate 20 having pixel circuits 20Pr, 20Pn. The photoelectric conversion unit 10 is for photoelectrically converting incident light, such as light having a wavelength in the infrared region, for each pixel P, and has, in order from the position closest to the circuit substrate 20, a first electrode 11, a first semiconductor layer 12, a photoelectric conversion film 13, a second semiconductor layer 14, and a second electrode 15. The pixel circuits 20Pr, 20Pn provided on the circuit substrate 20 are readout integrated circuits (ROICs) for signal charges generated in the photoelectric conversion unit 10, and are connected to the first electrode 11 of the photoelectric conversion unit 10 for each pixel P. The first electrode 11 and the pixel circuits 20Pr, 20Pn are connected via, for example, a bump electrode 17EB and a contact electrode 17EC. The first electrode 11 is provided in the passivation film 16, and the bump electrode 17EB and the contact electrode 17EC are provided in the interlayer insulating film 17.
[0022] The interlayer insulating film 17 is provided in contact with, for example, the circuit board 20. In the interlayer insulating film 17, a bump electrode 17EB and a contact electrode 17EC are provided for each pixel P. The contact electrode 17EC and the bump electrode 17EB are provided in this order from the position closest to the circuit board 20. The first electrode 11 and the bump electrode 17EB are in contact with each other, and the bump electrode 17EB and the contact electrode 17EC are in contact with each other. In this manner, the photoelectric conversion unit 10 and the circuit board 20 are bump-bonded. Instead of bump bonding, the photoelectric conversion unit 10 and the circuit board 20 may be CuCu-bonded. The interlayer insulating film 17 is made of, for example, an inorganic insulating material. Examples of the inorganic insulating material include silicon nitride (SiN), aluminum oxide (Al2O3), silicon oxide (SiO2), and hafnium oxide (HfO2).
[0023] The passivation film 16 is provided, for example, between the interlayer insulating film 17 and the first semiconductor layer 12. The first electrode 11 is provided for each pixel P in the passivation film 16. A part of the first electrode 11 may be provided in the interlayer insulating film 17. The passivation film 16 is made of, for example, an inorganic insulating material. Examples of the inorganic insulating material include silicon nitride (SiN), aluminum oxide (Al2O3), silicon oxide (SiO2), and hafnium oxide (HfO2). The passivation film 16 may be made of the same inorganic insulating material as the interlayer insulating film 17.
[0024] The first electrode 11 is electrically connected to the photoelectric conversion film 13 via the first semiconductor layer 12. The first electrode 11 is an electrode to which a voltage is supplied for reading out signal charges (holes or electrons; for convenience, the following description will be given assuming that the signal charges are holes) generated in the photoelectric conversion film 13, and is provided separately for each pixel P. One end of the first electrode 11 is in contact with the first semiconductor layer 12, and the first electrode 11 is electrically connected to the photoelectric conversion film 13 via the first semiconductor layer 12. The other end of the first electrode 11 is in contact with the bump electrode 17EB. Adjacent first electrodes 11 are electrically separated by a passivation film 16.
[0025] The first electrode 11 is made of, for example, any one of titanium (Ti), tungsten (W), titanium nitride (TiN), platinum (Pt), gold (Au), palladium (Pd), zinc (Zn), nickel (Ni), and aluminum (Al), or an alloy containing at least one of them. The first electrode 11 may be a single film of such a constituent material, or may be a laminated film combining two or more types. For example, the first electrode 11 is made of a laminated film of titanium and tungsten.
[0026] The first semiconductor layer 12 provided between the passivation film 16 and the photoelectric conversion film 13 is provided, for example, in common to all pixels P. This first semiconductor layer 12 serves to electrically separate adjacent pixels P, and the first semiconductor layer 12 is provided with, for example, a plurality of diffusion regions 12A. By using a compound semiconductor material having a band gap larger than the band gap of the compound semiconductor material constituting the photoelectric conversion film 13 for the first semiconductor layer 12, it is also possible to suppress dark current. For example, n-type InP (indium phosphide) can be used for the first semiconductor layer 12.
[0027] The diffusion regions 12A provided in the first semiconductor layer 12 are arranged to be spaced apart from each other. The diffusion region 12A is arranged for each pixel P, and the first electrode 11 is connected to each diffusion region 12A. The diffusion region 12A is for reading out the signal charge generated in the photoelectric conversion film 13 for each pixel P, and contains, for example, p-type impurities. Examples of p-type impurities include Zn (zinc). In this way, a pn junction interface is formed between the diffusion region 12A and the first semiconductor layer 12 other than the diffusion region 12A, so that adjacent pixels P are electrically isolated. The diffusion region 12A is provided, for example, in the thickness direction of the first semiconductor layer 12, and is also provided in a part of the thickness direction of the photoelectric conversion film 13.
[0028] The photoelectric conversion film 13 provided between the first semiconductor layer 12 and the second semiconductor layer 14 is provided across all the pixels P, for example. In other words, the photoelectric conversion film 13 is provided in common to all the pixels P. This photoelectric conversion film 13 absorbs light of a predetermined wavelength and generates a signal charge, and is made of a compound semiconductor material such as a III-V group semiconductor. Examples of the compound semiconductor material constituting the photoelectric conversion film 13 include InGaAs (indium gallium arsenide), InAsSb (indium arsenide antimony), GaAsSb (gallium arsenide antimony), InAs (indium arsenide), InSb (indium antimony), and HgCdTe (mercury cadmium tellurium). The photoelectric conversion film 13 may be made of Ge (germanium). The photoelectric conversion film 13 may be made of a semiconductor material having a Type II structure. In the photoelectric conversion film 13, for example, photoelectric conversion of light having a wavelength ranging from the visible region to the short infrared region is performed.
[0029] The second semiconductor layer 14 is provided, for example, in common to all pixels P. This second semiconductor layer 14 is provided between the photoelectric conversion film 13 and the second electrode 15 and is in contact with them. The second semiconductor layer 14 is a region where charges discharged from the second electrode 15 move, and is made of, for example, a compound semiconductor containing n-type impurities. For example, n-type InP (indium phosphide) can be used for the second semiconductor layer 14.
[0030] The second electrode 15 faces the first electrode 11 with the second semiconductor layer 14, the photoelectric conversion film 13, and the first semiconductor layer 12 between them. This second electrode 15 is provided on the second semiconductor layer 14 (light incident side) as an electrode common to each pixel P, for example, so as to be in contact with the second semiconductor layer 14. The second electrode 15 is for discharging charges that are not used as signal charges among the charges generated in the photoelectric conversion film 13 (cathode). For example, when holes are read out as signal charges from the first electrode 11, for example, electrons can be discharged through this second electrode 15. This second electrode 15 is connected to a predetermined potential V 15is applied to the second electrode 15. The second electrode 15 is made of a conductive film that is transmissive to incident light such as infrared light. For example, ITO (Indium Tin Oxide) or ITiO (In2O3-TiO2) can be used for the second electrode 15. The second electrode 15 may be made of InP (Indium Phosphide).
[0031] The pixel circuit 20Pr of the readout pixel Pr and the pixel circuit 20Pn of the non-readout pixel Pn provided on the circuit board 20 have, for example, the same configuration. Each of the pixel circuits 20Pr and 20Pn has, for example, an FD (floating diffusion) 21 (first charge storage section) connected to the photoelectric conversion section 10, a reset transistor (RST) 22, a potential generation section 23, an amplification transistor (AMP) 24, and a selection transistor (SEL) 25. In this embodiment, during a period in which the signal charge generated in the photoelectric conversion section 10 is stored in the FD 21 (storage period T10 in FIG. 6 described later), in the pixel circuit 20Pn of a part of the pixels P (non-readout pixels Pn), the reset transistor 22 is turned on, and a potential VPD is applied to the first electrode 11 from the potential generation section 23. On the other hand, in the pixel circuit 20Pr of the readout pixel Pr, the reset transistor 22 is in an off state. For example, the difference in the operation of the reset transistor 22 allows the readout pixels Pr and the non-readout pixels Pn to be distinguished from each other.
[0032] The FD 21 accumulates signal charges generated in the photoelectric conversion unit 10 (photoelectric conversion film 13). The FD 21 is connected to the first electrode 11 of the photoelectric conversion unit 10, the source of the reset transistor 22, and the gate of the amplification transistor 24.
[0033] The reset transistor 22 is for applying a reset potential VRST to the FD 21 when it is turned on. The FD 21 to which the reset potential VRST is applied is in an initial state (reset state). Here, the drain of the reset transistor 22 is connected to the potential generating unit 23. In the non-readout pixel Pn, during the period in which the signal charge generated in the photoelectric conversion unit 10 is accumulated in the FD 21, the reset transistor 22 is in an on state, and a potential VPD is applied from the potential generating unit 23 to the first electrode 11. The gate of the reset transistor 22 is connected to a control line Lps (FIG. 3), and the on and off of the reset transistor 22 is controlled by the control line Lps.
[0034] The potential generating unit 23 is connected to the photoelectric conversion unit 10 (first electrode 11) via the reset transistor 22. The potential generating unit 23, which is connected in series to the drain of the reset transistor 22, generates a reset potential VRST and a predetermined potential VPD different from the reset potential VRST. The potential VPD is, for example, a potential V 15 The potential is approximately the same as the potential V 15 ), this potential VPD is applied to the first electrode 11 via the reset transistor 22 in the ON state, so that the potential difference between the first electrode 11 and the second electrode 15 becomes approximately zero (0). The potential difference between the first electrode 11 and the second electrode 15 when the potential VPD is applied to the first electrode 11 is smaller than the potential difference between the first electrode 11 and the second electrode 15 when the reset potential VRST is applied to the first electrode 11 (|VPD-V 15 |<|VRST-V 15 |).
[0035] The gate of the amplifying transistor 24 is connected to the FD 21, the drain of the amplifying transistor 24 is connected to a power supply voltage VDD, and the source of the amplifying transistor 24 is connected to the drain of the selection transistor 25. The amplifying transistor 24 forms a source follower circuit together with a load MOS (Metal Oxide Semiconductor) serving as a constant current source connected via a vertical signal line Lsig. A pixel signal corresponding to the potential of the FD 21 is output from the amplifying transistor 24 to the horizontal selection unit 203 via the selection transistor 25.
[0036] A source of the selection transistor 25 is connected to the vertical signal line Lsig. When the selection transistor 25 is turned on, a pixel signal of the turned-on pixel P is output to the horizontal selection unit 203 via the vertical signal line Lsig.
[0037] [Image sensor 1 operation] The operation of the image sensor 1 will be described with reference to Fig. 5. In the image sensor 1, when light (e.g., light having a wavelength in the infrared region) is incident on the photoelectric conversion film 13 through the second electrode 15 and the second semiconductor layer 14, the light is absorbed in the photoelectric conversion film 13. As a result, pairs of holes and electrons are generated (photoelectrically converted) in the photoelectric conversion film 13 of each pixel P. At this time, in the readout pixel Pr, when a predetermined potential (e.g., a reset potential VRST) is applied to the first electrode 11, for example, a potential gradient is generated between the first electrode 11 and the second electrode 15, and one of the generated charges (e.g., a hole) moves to the diffusion region 12A as a signal charge and is collected from the diffusion region 12A to the first electrode 11 for each pixel P.
[0038] On the other hand, in the non-read pixel Pn, the potential VPD is applied to the first electrode 11, and the potential difference between the first electrode 11 and the second electrode 15 becomes approximately zero. Therefore, the signal charge generated in the photoelectric conversion film 13 of the non-read pixel Pn moves to the diffusion region 12A of the nearby readout pixel Pr. The signal charge that moves from the non-readout pixel Pn to the readout pixel Pr is added to the signal charge generated in the readout pixel Pr, and is read out by the pixel circuit 20Pr of the readout pixel Pr.
[0039] FIG. 6 is a timing chart of the reset transistor 22, the selection transistor 25, and the potential generating unit 23 during a period (accumulation period T10) during which signal charges are accumulated in the FD 21 of the readout pixel Pr.
[0040] First, the potential generating unit 23 of the pixel circuits 20Pr and 20Pn generates a reset potential VRST. In the pixel circuit 20Pr of the readout pixel Pr, the reset transistor 22 is turned on. This causes the potential of the FD21 to become the reset potential VRST, and the FD21 enters its initial state. Thereafter, the reset transistor 22 of the pixel circuit 20Pr is turned off. On the other hand, in the pixel circuit 20Pn of the non-readout pixel Pn, after the reset transistor 22 is turned on, it is maintained in the on state.
[0041] Next, the potential generating unit 23 of the pixel circuits 20Pr and 20Pn generates a potential VPD. After that, in the pixel circuit 20Pr of the readout pixel Pr, the selection transistor 25 is turned on at time t1 and then turned off at time t2. An accumulation period T10 of signal charges starts from this time t2. In the pixel circuit 20Pr, the reset transistor 22 is maintained in the off state throughout the accumulation period T10. Meanwhile, in the pixel circuit 20Pn of the non-readout pixel Pn, the reset transistor 22 is maintained in the on state and the selection transistor 25 is maintained in the off state at times t1 and t2. As a result, the potential VPD is applied to the first electrode 11 of the non-readout pixel Pn during the accumulation period T10.
[0042] After the accumulation period T10 has elapsed, in the pixel circuit 20Pr of the readout pixel Pr, the selection transistor 25 is turned on at time t3. This causes the potential of the FD21 of the pixel circuit 20Pr to be output to the horizontal selection unit 203 via the vertical signal line Lsig, and the accumulation period T10 ends (time t3). Thereafter, the selection transistor 25 of the pixel circuit 20Pr is turned off at time t4. Meanwhile, in the pixel circuit 20Pn of the non-readout pixel Pn, the off state of the selection transistor 25 is maintained at times t3 and t4. After time t4, the reset transistor 22 is turned off in the pixel circuit 20Pn. After the reset transistor 22 of the pixel circuit 20Pn is turned off, the potential generation unit 23 of the pixel circuits 20Pr and 20Pn generates the reset potential VRST.
[0043] [Actions and Effects of Image Sensor 1] In the image sensor 1 of the present embodiment, the pixel circuit 20Pn of the non-read pixel Pn is provided with the potential generating unit 23, and therefore, during the accumulation period T10, the potential VPD generated by the potential generating unit 23 is applied to the first electrode 11 of the non-read pixel Pn. As a result, in the non-read pixel Pn, the potential difference between the first electrode 11 and the second electrode 15 becomes small, and the signal charge generated in this non-read pixel Pn moves to the diffusion region 12A of the nearby readout pixel Pr. Therefore, the signal charge generated in the readout pixel Pr and the signal charge generated in the non-readout pixel Pn are summed and read out from the pixel circuit 20Pr of the readout pixel Pr.
[0044] One possible method for adding signal charges from multiple pixels is to add the pixel signals externally after reading them out. However, this method also adds readout noise. Other possible methods include using vertical signal lines and using an FD shared by multiple pixels. However, these methods have low freedom in arranging the non-readout pixels and readout pixels. Also, the method of using an FD shared by multiple pixels tends to reduce the photoelectric conversion efficiency.
[0045] It is also possible to provide an accumulation section for signal charges for addition in the image sensor, separate from the FD. However, this method also has a low degree of freedom in the arrangement of non-readout pixels and readout pixels. Furthermore, increasing the number of pixels to be added makes the layout more complex. In addition, noise caused by coupling is more likely to occur.
[0046] In contrast, in the present embodiment, the signal charges of the non-read pixels Pn move to the diffusion region 12A of the read pixel Pr, and the signal charges are added in the photoelectric conversion unit 10. Therefore, noise is not easily added. Furthermore, the arrangement of the read pixel Pr and the non-read pixel Pn can be adjusted by the control line Lps, and the arrangement of the read pixel Pr and the non-read pixel Pn can be freely set. For example, by providing the control line Lps in the row direction and the column direction (see FIG. 17 etc. described later), the read pixel Pr and the non-read pixel Pn can be freely arranged in two directions (row direction and column direction). Furthermore, the number of pixels P to be added can be freely adjusted. Furthermore, since the image sensor 1 does not require a storage unit for the signal charges for addition, the conversion efficiency of the photoelectric conversion can be maintained. In addition, the generation of noise caused by coupling can be suppressed.
[0047] As described above, in this embodiment, the pixel circuit 20Pn of the non-read pixel Pn is provided with the potential generating unit 23 that generates the potential VPD, so that the signal charge generated in the non-read pixel Pn is read out by the pixel circuit 20Pr of the read pixel Pr together with the signal charge generated in the read pixel Pr. This makes it possible to add up the signal charges of multiple pixels P.
[0048] Furthermore, in the image sensor 1, signal charges are read out only from the readout pixels Pr, excluding the non-readout pixels Pn, so that high-speed readout is possible.
[0049] Other embodiments and modifications will be described below, but in the following description, the same components as those in the first embodiment will be given the same reference numerals and the description thereof will be omitted as appropriate.
[0050] <Second embodiment> 7A and 7B show the circuit configuration of pixel circuits 20Pr, 20Pn of an image sensor (image sensor 1A) according to the second embodiment. The pixel circuits 20Pr, 20Pn have a potential generating section (potential generating section 23A) connected in parallel to the reset transistor 22 between the photoelectric conversion section 10 (first electrode 11) and the reset transistor 22. Except for this, the image sensor 1A according to the second embodiment has the same configuration as the image sensor 1 according to the first embodiment, and also has the same action and effect.
[0051] The pixel circuit 20Pr of the readout pixel Pr and the pixel circuit 20Pn of the non-readout pixel Pn have, for example, the same configuration. The potential generating unit 23A of the pixel circuits 20Pr and 20Pn includes a transistor 26 (first transistor) whose drain is connected to a potential VPD. This potential VPD is applied to the first electrode 11 via the transistor 26 in an on-state, so that the potential difference between the first electrode 11 and the second electrode 15 becomes approximately zero (0). In this embodiment, during a period in which the signal charge generated in the photoelectric conversion unit 10 is accumulated in the FD 21 (accumulation period T10 in FIG. 8 described later), in the pixel circuit 20Pn of the non-readout pixel Pn, the transistor 26 is turned on, and the potential VPD is applied to the first electrode 11 from the potential generating unit 23A. On the other hand, in the pixel circuit 20Pr of the readout pixel Pr, the transistor 26 is turned off. Due to such a difference in the operation of the transistor 26, the readout pixel Pr and the non-readout pixel Pn are distinguished from each other.
[0052] The source of the transistor 26 is connected to the FD 21, the source of the reset transistor 22, and the gate of the amplifying transistor 24. The gate of the transistor 26 is connected to a control line Lps (FIG. 3), and the on and off of the transistor 26 is controlled by the control line Lps. The transistor 26 may function as an overflow transistor during periods other than the accumulation period T10. The transistor 26 is formed of, for example, a thin film transistor.
[0053] The reset transistor 22 is connected in parallel to the transistor 26, between the source of the transistor 26 and the gate of the amplifying transistor 24. The drain of the reset transistor 22 is connected to a reset potential VRST.
[0054] FIG. 8 is a timing chart of the reset transistor 22, the selection transistor 25, and the transistor 26 (potential generating unit 23A) during a period (accumulation period T10) during which signal charges are accumulated in the FD 21 of the readout pixel Pr.
[0055] First, in the pixel circuit 20Pr of the readout pixel Pr, the reset transistor 22 is turned on. This causes the potential of the FD21 to become the reset potential VRST, and the FD21 enters its initial state. After that, the reset transistor 22 of the pixel circuit 20Pr is turned off. During this time, the transistor 26 of the pixel circuit 20Pr is maintained in the off state. Meanwhile, in the pixel circuit 20Pn of the non-readout pixel Pn, the reset transistor 22 is maintained in the off state and the transistor 26 is maintained in the on state.
[0056] Thereafter, in the pixel circuit 20Pr of the readout pixel Pr, the selection transistor 25 is turned on at time t1 and then turned off at time t2. An accumulation period T10 of signal charges starts from time t2. In the pixel circuit 20Pr, the reset transistor 22 is maintained in an off state, the selection transistor 25 is maintained in an off state, and the transistor 26 is maintained in an off state throughout the accumulation period T10. Meanwhile, in the pixel circuit 20Pn of the non-readout pixel Pn, the reset transistor 22 is maintained in an off state, the selection transistor 25 is maintained in an off state, and the transistor 26 is maintained in an on state at times t1 and t2. As a result, during the accumulation period T10, a potential VPD is applied to the first electrode 11 of the non-readout pixel Pn via the transistor 26.
[0057] After the accumulation period T10 has elapsed, in the pixel circuit 20Pr of the readout pixel Pr, the selection transistor 25 is turned on at time t3. This causes the potential of the FD21 of the pixel circuit 20Pr to be output to the horizontal selection unit 203 via the vertical signal line Lsig, and the accumulation period T10 ends (time t3). Thereafter, the selection transistor 25 of the pixel circuit 20Pr is turned off at time t4. Meanwhile, in the pixel circuit 20Pn of the non-readout pixel Pn, the reset transistor 22 is maintained in the off state, the selection transistor 25 is maintained in the off state, and the transistor 26 is maintained in the on state at times t3 and t4.
[0058] In the image sensor 1A, similarly to the image sensor 1 described above, the pixel circuit 20Pn of the non-read pixel Pn is provided with the potential generating unit 23A, so that the potential difference between the first electrode 11 and the second electrode 15 in the non-read pixel Pn becomes small, and the signal charge generated in the non-read pixel Pn moves to the diffusion region 12A of the nearby readout pixel Pr. Therefore, the signal charge generated in the readout pixel Pr and the signal charge generated in the non-readout pixel Pn are added together and read out from the pixel circuit 20Pr of the readout pixel Pr.
[0059] <Variation 1> In the above second embodiment, the pixel circuit 20Pr of the readout pixel Pr and the pixel circuit 20Pn of the non-readout pixel Pn have the same configuration. However, they may have different configurations.
[0060] For example, when the arrangement of the readout pixels Pr and the non-readout pixels Pn is fixed, the potential generating unit 23A (transistor 26) of the pixel circuit 20Pr of the readout pixel Pr may be omitted.
[0061] 9 shows an example of the configuration of a pixel circuit 20Pr that does not have a potential generating unit 23A (transistor 26). In this manner, instead of the potential generating unit 23A, the pixel circuit 20Pr may have a capacitance switching transistor 27 (third transistor) and an additional capacitance element 28.
[0062] The transistor 27 is for switching the capacitance of the FD 21. The transistor 27 is connected in parallel to the reset transistor 22, for example, between the photoelectric conversion unit 10 and the reset transistor 22. The source of the transistor 27 is connected to the FD 21, and the drain of the transistor 27 is connected to one end of the additional capacitance element 28. The other end of the additional capacitance element 28 is connected to, for example, a ground potential (GND).
[0063] When the transistor 27 is turned on, the additional capacitance element 28 is connected to the FD 21, and a state in which a large amount of signal charge can be stored (high capacitance selection state) is achieved. When the transistor 27 is turned off, the FD 21 and the additional capacitance element 28 are disconnected, and a state in which a small amount of signal charge can be stored (low capacitance selection state) is achieved. In this way, the dynamic range may be switched when the signal charges of multiple pixels P are added together.
[0064] <Variation 2> 10 shows an example of a circuit configuration of pixel circuits 20Pr, 20Pn according to a modification (modification 2) of the second embodiment. The pixel circuits 20Pr, 20Pn include a charge storage unit 31 connected to the photoelectric conversion unit 10, and a transfer transistor 32 disposed between the charge storage unit 31 and the FD 21. By providing the charge storage unit 31 and the transfer transistor 32 in the pixel circuits 20Pr, 20Pn in this manner, it is possible to realize an image sensor 1A having a global shutter function.
[0065] One end of the charge accumulation unit 31 is connected to the photoelectric conversion unit 10 (first electrode 11) and the source of the transfer transistor 32. The charge accumulation unit 31 is a charge holding unit for temporarily holding the signal charge generated in the photoelectric conversion unit 10.
[0066] A drain of the transfer transistor 32 is connected to the FD 21. When the transfer transistor 32 is turned on, the signal charge temporarily held in the charge accumulation unit 31 is read out and transferred to the FD 21. For example, the potential generation unit 23A (transistor 26) is disposed between the charge accumulation unit 31 and the transfer transistor 32.
[0067] <Third embodiment> 11A and 11B show the circuit configuration of pixel circuits 20Pr, 20Pn of an image sensor (image sensor 1B) according to the third embodiment. The pixel circuits 20Pr, 20Pn have a potential generating unit (potential generating unit 23B) connected in series to the photoelectric conversion unit 10 between the photoelectric conversion unit 10 (first electrode 11) and the FD 21. Except for this, the image sensor 1B according to the third embodiment has the same configuration as the image sensor 1 according to the first embodiment, and also has the same action and effect.
[0068] The pixel circuit 20Pr of the readout pixel Pr and the pixel circuit 20Pn of the non-readout pixel Pn have, for example, the same configuration. The potential generating unit 23B of the pixel circuits 20Pr and 20Pn includes a transistor 29 (first transistor). In this embodiment, during a period in which the signal charge generated in the photoelectric conversion unit 10 is accumulated in the FD21 (accumulation period T10 in FIG. 12 described later), in the pixel circuit 20Pn of the non-readout pixel Pn, the transistor 29 is turned off and the photoelectric conversion unit 10 and the FD21 are not connected. As a result, the potential difference between the first electrode 11 and the second electrode 15 becomes approximately zero (0). On the other hand, in the pixel circuit 20Pr of the readout pixel Pr, the transistor 29 is turned on and the photoelectric conversion unit 10 and the FD21 are connected. The readout pixel Pr and the non-readout pixel Pn are distinguished from each other by the difference in the operation of the transistor 29.
[0069] For example, the drain of the transistor 29 is connected to the photoelectric conversion unit 10, and the source of the transistor 29 is connected to the FD 21. The gate of the transistor 29 is connected to a control line Lps (FIG. 3), and the on and off of the transistor 29 is controlled by the control line Lps. The transistor 29 is, for example, a thin film transistor.
[0070] The reset transistor 22 is disposed between the source of the transistor 29 and the gate of the amplifying transistor 24. The drain of the reset transistor 22 is connected to a reset potential VRST.
[0071] FIG. 12 is a timing chart of the reset transistor 22, the selection transistor 25, and the transistor 29 (potential generating unit 23B) during a period (accumulation period T10) during which signal charges are accumulated in the FD 21 of the readout pixel Pr.
[0072] First, in the pixel circuit 20Pr of the readout pixel Pr, the reset transistor 22 is turned on. This causes the potential of the FD21 to become the reset potential VRST, and the FD21 enters its initial state. After that, the reset transistor 22 of the pixel circuit 20Pr is turned off. During this time, the transistor 29 of the pixel circuit 20Pr is maintained in the on state. Meanwhile, in the pixel circuit 20Pn of the non-readout pixel Pn, the reset transistor 22 is maintained in the off state and the transistor 29 is maintained in the off state.
[0073] After that, in the pixel circuit 20Pr of the readout pixel Pr, the selection transistor 25 is turned on at time t1 and then turned off at time t2. The signal charge accumulation period T10 starts from this time t2. In the pixel circuit 20Pr, the reset transistor 22 is maintained in the off state, the selection transistor 25 is maintained in the off state, and the transistor 29 is maintained in the on state during the accumulation period T10. Meanwhile, in the pixel circuit 20Pn of the non-readout pixel Pn, the reset transistor 22 is maintained in the off state, the selection transistor 25 is maintained in the off state, and the transistor 29 is maintained in the off state during times t1, t2, and the accumulation period T10. As a result, the first electrode 11 of the non-readout pixel Pn has substantially the same potential as the second electrode 15 during the accumulation period T10. In other words, the potential VPD is applied to the first electrode 11 of the non-readout pixel Pn.
[0074] After the accumulation period T10 has elapsed, in the pixel circuit 20Pr of the readout pixel Pr, the selection transistor 25 is turned on at time t3. This causes the potential of the FD21 of the pixel circuit 20Pr to be output to the horizontal selection unit 203 via the vertical signal line Lsig, and the accumulation period T10 ends (time t3). Thereafter, the selection transistor 25 of the pixel circuit 20Pr is turned off at time t4. Meanwhile, in the pixel circuit 20Pn of the non-readout pixel Pn, the reset transistor 22 is maintained in the off state, the selection transistor 25 is maintained in the off state, and the transistor 29 is maintained in the off state at times t3 and t4.
[0075] In the image sensor 1B, similarly to the image sensor 1 described above, the pixel circuit 20Pn of the non-read pixel Pn is provided with a potential generating unit 23B, so that the potential difference between the first electrode 11 and the second electrode 15 in the non-read pixel Pn becomes small, and the signal charge generated in the non-read pixel Pn moves to the diffusion region 12A of the nearby readout pixel Pr. Therefore, the signal charge generated in the readout pixel Pr and the signal charge generated in the non-readout pixel Pn are added together and read out from the pixel circuit 20Pr of the readout pixel Pr.
[0076] The pixel circuit 20Pr of the readout pixel Pr and the pixel circuit 20Pn of the non-readout pixel Pn may have different configurations, as described in the first modification example above.
[0077] For example, when the arrangement of the readout pixels Pr and the non-readout pixels Pn is fixed, the potential generating unit 23B (transistor 29) of the pixel circuit 20Pr of the readout pixel Pr may be omitted. The pixel circuit 20Pr may be provided with a capacitance switching transistor 27 and an additional capacitance element 28 instead of the potential generating unit 23B.
[0078] 13 shows another example of the pixel circuits 20Pr, 20Pn described in the third embodiment. The pixel circuits 20Pr, 20Pn include a charge storage section 31 and a transfer transistor 32, as described in the second modification. By providing the charge storage section 31 and the transfer transistor 32 in the pixel circuits 20Pr, 20Pn in this way, it is possible to realize an image sensor 1B having a global shutter function. The charge storage section 31 is connected to the photoelectric conversion section 10 via the potential generation section 23B (transistor 29).
[0079] <Fourth embodiment> 14A and 14B show the circuit configuration of pixel circuits 20Pr, 20Pn of an image sensor (image sensor 1C) according to the fourth embodiment. The image sensor 1C is an image sensor having a global shutter function, and the potential generating section (potential generating section 23C) of the pixel circuits 20Pr, 20Pn includes a charge storage section 31 (second charge storage section) provided for each pixel P, and a transfer transistor 32 (second transistor) provided between the charge storage section 31 and the FD 21. Except for this point, the image sensor 1C according to the fourth embodiment has the same configuration as the image sensor 1 according to the first embodiment, and also has the same action and effect.
[0080] The pixel circuit 20Pr of the readout pixel Pr and the pixel circuit 20Pn of the non-readout pixel Pn have, for example, the same configuration. In this embodiment, during a period in which the signal charge generated in the photoelectric conversion unit 10 is accumulated in the FD21 (accumulation period T10 in FIG. 15 described later), in the pixel circuit 20Pn of the non-readout pixel Pn, the transfer transistor 32 is turned off, and the charge accumulation unit 31 and the FD21 are not connected. As a result, as the signal charge is accumulated in the charge accumulation unit 31, the potential difference between the first electrode 11 and the second electrode 15 becomes approximately zero (0). On the other hand, in the pixel circuit 20Pr of the readout pixel Pr, the transfer transistor 32 is normally driven, and the signal charge is transferred from the charge accumulation unit 31 to the FD21 during the accumulation period T10. The readout pixel Pr and the non-readout pixel Pn are distinguished from each other by the difference in the operation of the transfer transistor 32.
[0081] The charge accumulation unit 31 is provided between the photoelectric conversion unit 10 (first electrode 11) and the FD 21. As described in the above modification example 2, one end of the charge accumulation unit 31 is connected to the photoelectric conversion unit 10 (first electrode 11) and the source of the transfer transistor 32. The drain of the transfer transistor 32 is connected to the FD 21.
[0082] The source of the reset transistor 22 is connected to the drain of the transfer transistor 32, the FD 21, and the gate of the amplifying transistor 24. The drain of the reset transistor 22 is connected to a reset potential VRST.
[0083] FIG. 15 is a timing chart of the reset transistor 22, the selection transistor 25, and the transfer transistor 32 during a period (accumulation period T10) during which signal charges are accumulated in the FD 21 of the readout pixel Pr.
[0084] First, in the pixel circuit 20Pr of the readout pixel Pr, the reset transistor 22 and the transfer transistor 32 are simultaneously turned on. As a result, the potentials of the FD21 and the charge storage unit 31 become the reset potential VRST, and the FD21 and the charge storage unit 31 are in their initial states. Then, at time t5, the reset transistor 22 and the transfer transistor 32 of the pixel circuit 20Pr are simultaneously turned off. The signal charge accumulation period T10 starts from this time t5. Then, in the pixel circuit 20Pr of the readout pixel Pr, the selection transistor 25 is turned on at time t6 and then turned off at time t7. On the other hand, in the pixel circuit 20Pn of the non-readout pixel Pn, the reset transistor 22 is maintained in the off state, the selection transistor 25 is maintained in the off state, and the transfer transistor 32 is maintained in the off state from time t5 to time t7.
[0085] Just before the end of the accumulation period T10, the transfer transistor 32 of the pixel circuit 20Pr is turned on. As a result, the potential of the charge accumulation unit 31 of the pixel circuit 20Pr is output to the FD21 via the transfer transistor 32. Thereafter, at time t8, the transfer transistor 32 is turned off and the selection transistor 25 is turned on. As a result, the potential of the FD21 of the pixel circuit 20Pr is output to the horizontal selection unit 203 via the vertical signal line Lsig, and the accumulation period T10 ends (time t8). Thereafter, the selection transistor 25 of the pixel circuit 20Pr is turned off at time t9.
[0086] On the other hand, in the pixel circuit 20Pn of the non-read pixel Pn, the reset transistor 22 is maintained in the off state, the selection transistor 25 is maintained in the off state, and the transfer transistor 32 is maintained in the off state during and after the accumulation period T10. As a result, during the accumulation period T10, the first electrode 11 of the non-read pixel Pn has substantially the same potential as the second electrode 15. In other words, the potential VPD is applied to the first electrode 11 of the non-read pixel Pn.
[0087] In the image sensor 1C, similarly to the image sensor 1 described above, the pixel circuit 20Pn of the non-read pixel Pn is provided with a potential generating unit 23C, so that the potential difference between the first electrode 11 and the second electrode 15 in the non-read pixel Pn becomes small, and the signal charge generated in the non-read pixel Pn moves to the diffusion region 12A of the nearby readout pixel Pr. Therefore, the signal charge generated in the readout pixel Pr and the signal charge generated in the non-readout pixel Pn are added together and read out from the pixel circuit 20Pr of the readout pixel Pr.
[0088] <Modification 3> 2, the readout pixels Pr and the non-readout pixels Pn are arranged alternately for each row of pixels P. However, the readout pixels Pr and the non-readout pixels Pn can be arranged freely. For example, although not shown, the readout pixels Pr and the non-readout pixels Pn may be arranged alternately for each column of pixels P.
[0089] For example, as shown in Figures 16A and 16B, a row of readout pixels Pr may be arranged for every two or three rows of pixels P. In this case, the signal charges of three or four pixels P adjacent in the column direction are added together. A row of readout pixels Pr may be arranged for every four or more rows of pixels P. A row of readout pixels Pr may be arranged for every two, three, or four or more columns of pixels P.
[0090] 17 shows an example of an arrangement of readout pixels Pr and non-readout pixels Pn. In this manner, one readout pixel Pr may be arranged for two rows and two columns of pixels P. In this case, the signal charges of four (two rows and two columns) pixels P are added together.
[0091] Fig. 18 shows an example of the configuration of the control lines (control lines Lps1, Lps2) connected to the readout pixels Pr and non-readout pixels Pn in Fig. 17. The image pickup elements 1, 1A, 1B, and 1C each have, for example, a plurality of control lines Lps1 extending in the row direction and a plurality of control lines Lps2 extending in the column direction.
[0092] Fig. 19 and Fig. 20 show an example of the circuit configuration of the pixel circuits 20Pr, 20Pn provided in the readout pixel Pr and the non-readout pixel Pn in Fig. 17. For example, the pixel circuits 20Pr, 20Pn (see Fig. 4) of the image sensor 1 described in the first embodiment have, for example, a reset transistor 22A connected to the control line Lps1 and a reset transistor 22B connected to the control line Lps2 (Fig. 19). The pixel circuits 20Pr, 20Pn (see Figs. 7A and 7B) of the image sensor 2 described in the second embodiment have, for example, a transistor 26A connected to the control line Lps1 and a transistor 26B connected to the control line Lps2 (Fig. 20).
[0093] 21A and 21B, one readout pixel Pr may be arranged for 3 rows x 3 columns or 4 rows x 4 columns of pixels P. One readout pixel Pr may be arranged for 5 rows x 5 columns or more of pixels P. For example, it is possible to add up the signal charges of multiple pixels P arranged within an area of 100 μm x 100 μm.
[0094] <Application Examples> The above-mentioned imaging elements 1, 1A, 1B, and 1C can be applied to various types of imaging devices (electronic devices), such as cameras capable of imaging in the infrared region. Fig. 22 shows a schematic configuration of an electronic device 3 (camera) as an example. The electronic device 3 is, for example, a camera capable of capturing still images or moving images, and includes imaging elements 1, 1A, 1B, and 1C, an optical system (optical lens) 310, a shutter device 311, a drive unit 313 that drives the imaging elements 1, 1A, 1B, and 1C and the shutter device 311, and a signal processing unit 312.
[0095] The optical system 310 guides image light (incident light) from a subject to the imaging elements 1, 1A, 1B, and 1C. This optical system 310 may be composed of a plurality of optical lenses. The shutter device 311 controls the light irradiation period and the light blocking period for the imaging elements 1, 1A, 1B, and 1C. The drive unit 313 controls the transfer operation of the imaging elements 1, 1A, 1B, and 1C and the shutter operation of the shutter device 311. The signal processing unit 312 performs various signal processing on the signals output from the imaging elements 1, 1A, 1B, and 1C. The video signal Dout after the signal processing is stored in a storage medium such as a memory, or is output to a monitor, etc.
[0096] <Application example to in-body information acquisition system> Furthermore, the technology according to the present disclosure (the present technology) can be applied to various products. For example, the technology according to the present disclosure may be applied to an endoscopic surgery system.
[0097] FIG. 23 is a block diagram showing an example of a schematic configuration of a patient's in-vivo information acquisition system using a capsule endoscope to which the technology according to the present disclosure (the present technology) can be applied.
[0098] The in-vivo information acquisition system 10001 includes a capsule endoscope 10100 and an external control device 10200 .
[0099] The capsule endoscope 10100 is swallowed by a patient during an examination. The capsule endoscope 10100 has an imaging function and a wireless communication function, and while moving inside an organ such as the stomach or intestines by peristalsis or the like until it is naturally discharged from the patient, sequentially captures images of the inside of the organ (hereinafter also referred to as in-vivo images) at predetermined intervals, and sequentially wirelessly transmits information about the in-vivo images to an external control device 10200 outside the body.
[0100] The external control device 10200 comprehensively controls the operation of the in-vivo information acquisition system 10001. In addition, the external control device 10200 receives information about the in-vivo image transmitted from the capsule endoscope 10100, and generates image data for displaying the in-vivo image on a display device (not shown) based on the received information about the in-vivo image.
[0101] In this manner, the in-vivo information acquiring system 10001 can obtain in-vivo images capturing images of the state inside the patient's body at any time from when the capsule endoscope 10100 is swallowed to when it is expelled.
[0102] The configurations and functions of the capsule endoscope 10100 and the external control device 10200 will be described in more detail.
[0103] The capsule endoscope 10100 has a capsule-shaped housing 10101, which houses a light source unit 10111, an imaging unit 10112, an image processing unit 10113, a wireless communication unit 10114, a power supply unit 10115, a power supply unit 10116, and a control unit 10117.
[0104] The light source unit 10111 is composed of a light source such as an LED (light emitting diode), and irradiates the imaging field of the imaging unit 10112 with light.
[0105] The imaging unit 10112 is composed of an imaging element and an optical system consisting of multiple lenses provided in front of the imaging element. Reflected light (hereinafter referred to as observation light) of light irradiated onto the body tissue to be observed is collected by the optical system and enters the imaging element. In the imaging unit 10112, the imaging element photoelectrically converts the observation light incident thereon, and generates an image signal corresponding to the observation light. The image signal generated by the imaging unit 10112 is provided to an image processing unit 10113.
[0106] The image processing unit 10113 is configured with a processor such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), and performs various signal processing on the image signal generated by the imaging unit 10112. The image processing unit 10113 provides the image signal after the signal processing to the wireless communication unit 10114 as RAW data.
[0107] The wireless communication unit 10114 performs predetermined processing such as modulation processing on the image signal that has been subjected to signal processing by the image processing unit 10113, and transmits the image signal to the external control device 10200 via the antenna 10114A. The wireless communication unit 10114 also receives a control signal related to drive control of the capsule endoscope 10100 from the external control device 10200 via the antenna 10114A. The wireless communication unit 10114 provides the control signal received from the external control device 10200 to the control unit 10117.
[0108] The power supply unit 10115 is composed of an antenna coil for receiving power, a power regeneration circuit for regenerating power from a current generated in the antenna coil, a boost circuit, etc. In the power supply unit 10115, power is generated using the principle of so-called non-contact charging.
[0109] The power supply unit 10116 is composed of a secondary battery, and stores the power generated by the power supply unit 10115. In order to avoid cluttering the drawing, arrows and other symbols indicating the destination of the power supply from the power supply unit 10116 are omitted in Fig. 23, but the power stored in the power supply unit 10116 is supplied to the light source unit 10111, the imaging unit 10112, the image processing unit 10113, the wireless communication unit 10114, and the control unit 10117 and can be used to drive these units.
[0110] The control unit 10117 is composed of a processor such as a CPU, and appropriately controls the driving of the light source unit 10111, the imaging unit 10112, the image processing unit 10113, the wireless communication unit 10114, and the power supply unit 10115 in accordance with control signals transmitted from the external control device 10200.
[0111] The external control device 10200 is composed of a processor such as a CPU or a GPU, or a microcomputer or a control board in which a processor and a storage element such as a memory are mixed. The external control device 10200 controls the operation of the capsule endoscope 10100 by transmitting a control signal to the control unit 10117 of the capsule endoscope 10100 via the antenna 10200A. In the capsule endoscope 10100, for example, the light irradiation conditions for the observation target in the light source unit 10111 can be changed by the control signal from the external control device 10200. Furthermore, the imaging conditions (for example, the frame rate and exposure value in the imaging unit 10112) can be changed by the control signal from the external control device 10200. Furthermore, the content of the processing in the image processing unit 10113 and the conditions for the wireless communication unit 10114 to transmit an image signal (for example, the transmission interval, the number of transmitted images, etc.) may be changed by the control signal from the external control device 10200.
[0112] The external control device 10200 also applies various image processing to the image signal transmitted from the capsule endoscope 10100 to generate image data for displaying the captured in-vivo image on a display device. As the image processing, various signal processing such as development processing (demosaic processing), image quality improvement processing (band enhancement processing, super-resolution processing, NR (Noise reduction) processing, and / or image stabilization processing, etc.) and / or enlargement processing (electronic zoom processing) can be performed. The external control device 10200 controls the driving of the display device to display the captured in-vivo image based on the generated image data. Alternatively, the external control device 10200 may record the generated image data in a recording device (not shown) or print out the image data on a printing device (not shown).
[0113] An example of an in-vivo information acquisition system to which the technology according to the present disclosure can be applied has been described above. The technology according to the present disclosure can be applied to, for example, the imaging unit 10112 of the above-described configuration. This improves detection accuracy.
[0114] <Application example to endoscopic surgery system> The technology according to the present disclosure (the present technology) can be applied to various products. For example, the technology according to the present disclosure may be applied to an endoscopic surgery system.
[0115] FIG. 24 is a diagram showing an example of a schematic configuration of an endoscopic surgery system to which the technology according to the present disclosure (the present technology) can be applied.
[0116] 24 shows a state in which an operator (doctor) 11131 is performing surgery on a patient 11132 on a patient bed 11133 using an endoscopic surgery system 11000. As shown in the figure, the endoscopic surgery system 11000 is composed of an endoscope 11100, other surgical tools 11110 such as an insufflation tube 11111 and an energy treatment tool 11112, a support arm device 11120 that supports the endoscope 11100, and a cart 11200 on which various devices for endoscopic surgery are mounted.
[0117] The endoscope 11100 is composed of a lens barrel 11101, a region of a predetermined length from the tip of which is inserted into a body cavity of a patient 11132, and a camera head 11102 connected to the base end of the lens barrel 11101. In the illustrated example, the endoscope 11100 is configured as a so-called rigid scope having a rigid lens barrel 11101, but the endoscope 11100 may be configured as a so-called flexible scope having a flexible lens barrel.
[0118] An opening into which an objective lens is fitted is provided at the tip of the lens barrel 11101. A light source device 11203 is connected to the endoscope 11100, and light generated by the light source device 11203 is guided to the tip of the lens barrel by a light guide extending inside the lens barrel 11101, and is irradiated via the objective lens toward an observation target in the body cavity of the patient 11132. The endoscope 11100 may be a direct-viewing endoscope, an oblique-viewing endoscope, or a side-viewing endoscope.
[0119] An optical system and an image sensor are provided inside the camera head 11102, and reflected light (observation light) from an observation target is collected on the image sensor by the optical system. The observation light is photoelectrically converted by the image sensor to generate an electrical signal corresponding to the observation light, i.e., an image signal corresponding to an observation image. The image signal is transmitted to a camera control unit (CCU) 11201 as RAW data.
[0120] The CCU 11201 is configured with a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), etc., and performs overall control of the operations of the endoscope 11100 and the display device 11202. Furthermore, the CCU 11201 receives an image signal from the camera head 11102, and performs various types of image processing on the image signal, such as development processing (demosaic processing), for displaying an image based on the image signal.
[0121] Under the control of the CCU 11201, the display device 11202 displays an image based on an image signal that has been subjected to image processing by the CCU 11201.
[0122] The light source device 11203 is composed of a light source such as an LED (light emitting diode), and supplies the endoscope 11100 with irradiation light when photographing an operation site or the like.
[0123] The input device 11204 is an input interface for the endoscopic surgery system 11000. A user can input various information and instructions to the endoscopic surgery system 11000 via the input device 11204. For example, the user inputs an instruction to change the imaging conditions (type of irradiated light, magnification, focal length, etc.) of the endoscope 11100.
[0124] The treatment tool control device 11205 controls the driving of the energy treatment tool 11112 for cauterizing tissue, incising, sealing blood vessels, etc. The insufflation device 11206 sends gas into the body cavity of the patient 11132 via the insufflation tube 11111 to inflate the body cavity for the purpose of securing the field of view of the endoscope 11100 and securing the working space of the surgeon. The recorder 11207 is a device capable of recording various information related to the surgery. The printer 11208 is a device capable of printing various information related to the surgery in various formats such as text, image, or graph.
[0125] The light source device 11203 that supplies irradiation light to the endoscope 11100 when photographing the surgical site can be composed of a white light source composed of, for example, an LED, a laser light source, or a combination of these. When the white light source is composed of a combination of RGB laser light sources, the output intensity and output timing of each color (each wavelength) can be controlled with high precision, so that the white balance of the captured image can be adjusted in the light source device 11203. In this case, it is also possible to capture images corresponding to each of the RGB colors in a time-division manner by irradiating the observation object with laser light from each of the RGB laser light sources in a time-division manner and controlling the driving of the image sensor of the camera head 11102 in synchronization with the irradiation timing. According to this method, a color image can be obtained without providing a color filter to the image sensor.
[0126] The light source device 11203 may be controlled to change the intensity of the light it outputs at predetermined time intervals. The driving of the image sensor of the camera head 11102 may be controlled in synchronization with the timing of the change in the light intensity to obtain images in a time-division manner, and the images may be synthesized to generate an image with a high dynamic range that is free of so-called blackout and whiteout.
[0127] The light source device 11203 may be configured to supply light of a predetermined wavelength band corresponding to the special light observation. In the special light observation, for example, by utilizing the wavelength dependency of light absorption in body tissue, a narrow band light is irradiated compared to the irradiated light (i.e., white light) during normal observation, and a predetermined tissue such as blood vessels on the mucous membrane surface is photographed with high contrast, so-called narrow band imaging is performed. Alternatively, in the special light observation, a fluorescent observation may be performed in which an image is obtained by fluorescence generated by irradiating an excitation light. In the fluorescent observation, it is possible to irradiate an excitation light to a body tissue and observe the fluorescence from the body tissue (autofluorescence observation), or to locally inject a reagent such as indocyanine green (ICG) into the body tissue and irradiate the body tissue with excitation light corresponding to the fluorescent wavelength of the reagent to obtain a fluorescent image. The light source device 11203 may be configured to supply narrow band light and / or excitation light corresponding to such special light observation.
[0128] FIG. 25 is a block diagram showing an example of the functional configuration of the camera head 11102 and the CCU 11201 shown in FIG.
[0129] The camera head 11102 has a lens unit 11401, an imaging unit 11402, a drive unit 11403, a communication unit 11404, and a camera head control unit 11405. The CCU 11201 has a communication unit 11411, an image processing unit 11412, and a control unit 11413. The camera head 11102 and the CCU 11201 are connected to each other by a transmission cable 11400 so as to be able to communicate with each other.
[0130] The lens unit 11401 is an optical system provided at the connection portion with the lens barrel 11101. Observation light taken in from the tip of the lens barrel 11101 is guided to the camera head 11102 and enters the lens unit 11401. The lens unit 11401 is configured by combining a plurality of lenses including a zoom lens and a focus lens.
[0131] The imaging unit 11402 may include one imaging element (so-called single-plate type) or multiple imaging elements (so-called multiple-plate type). When the imaging unit 11402 is configured as a multiple-plate type, for example, each imaging element may generate an image signal corresponding to each of RGB, and a color image may be obtained by combining the image signals. Alternatively, the imaging unit 11402 may be configured to have a pair of imaging elements for acquiring image signals for the right eye and the left eye corresponding to a 3D (dimensional) display. By performing a 3D display, the surgeon 11131 can more accurately grasp the depth of the biological tissue in the surgical site. Note that when the imaging unit 11402 is configured as a multiple-plate type, the lens unit 11401 may also be provided in multiple systems corresponding to each imaging element.
[0132] Furthermore, the imaging unit 11402 does not necessarily have to be provided in the camera head 11102. For example, the imaging unit 11402 may be provided inside the lens barrel 11101, immediately behind the objective lens.
[0133] The driving unit 11403 is configured by an actuator, and moves the zoom lens and focus lens of the lens unit 11401 by a predetermined distance along the optical axis under the control of the camera head control unit 11405. This allows the magnification and focus of the image captured by the imaging unit 11402 to be appropriately adjusted.
[0134] The communication unit 11404 is configured by a communication device for transmitting and receiving various information to and from the CCU 11201. The communication unit 11404 transmits the image signal obtained from the imaging unit 11402 to the CCU 11201 via the transmission cable 11400 as RAW data.
[0135] Furthermore, the communication unit 11404 receives a control signal for controlling the driving of the camera head 11102 from the CCU 11201, and supplies the control signal to the camera head control unit 11405. The control signal includes information on the imaging conditions, such as information specifying the frame rate of the captured image, information specifying the exposure value at the time of capturing the image, and / or information specifying the magnification and focus of the captured image.
[0136] The image capturing conditions such as the frame rate, exposure value, magnification, and focus may be appropriately specified by a user, or may be automatically set by the control unit 11413 of the CCU 11201 based on an acquired image signal. In the latter case, the endoscope 11100 is equipped with a so-called AE (Auto Exposure) function, AF (Auto Focus) function, and AWB (Auto White Balance) function.
[0137] The camera head control unit 11405 controls the driving of the camera head 11102 based on a control signal received from the CCU 11201 via the communication unit 11404.
[0138] The communication unit 11411 is configured with a communication device for transmitting and receiving various information to and from the camera head 11102. The communication unit 11411 receives an image signal transmitted from the camera head 11102 via the transmission cable 11400.
[0139] Furthermore, the communication unit 11411 transmits, to the camera head 11102, a control signal for controlling the driving of the camera head 11102. The image signal and the control signal can be transmitted by electrical communication, optical communication, or the like.
[0140] The image processing unit 11412 performs various types of image processing on the image signal, which is RAW data sent from the camera head 11102 .
[0141] The control unit 11413 performs various controls related to imaging of the surgical site etc. by the endoscope 11100 and display of the captured image obtained by imaging the surgical site etc. For example, the control unit 11413 generates a control signal for controlling the driving of the camera head 11102.
[0142] Further, the control unit 11413 causes the display device 11202 to display the captured image showing the surgical site, etc., based on the image signal that has been image-processed by the image processing unit 11412. At this time, the control unit 11413 may recognize various objects in the captured image using various image recognition techniques. For example, the control unit 11413 can recognize surgical tools such as forceps, specific living body parts, bleeding, mist when the energy treatment tool 11112 is used, etc., by detecting the shape and color of the edge of an object included in the captured image. When the control unit 11413 causes the display device 11202 to display the captured image, it may use the recognition result to superimpose various types of surgery support information on the image of the surgical site. By superimposing and presenting the surgery support information to the surgeon 11131, the burden on the surgeon 11131 can be reduced and the surgeon 11131 can proceed with the surgery reliably.
[0143] The transmission cable 11400 connecting the camera head 11102 and the CCU 11201 is an electrical signal cable for communication of electrical signals, an optical fiber for optical communication, or a composite cable of these.
[0144] Here, in the illustrated example, communication is performed wired using a transmission cable 11400, but communication between the camera head 11102 and the CCU 11201 may also be performed wirelessly.
[0145] An example of an endoscopic surgery system to which the technology according to the present disclosure can be applied has been described above. The technology according to the present disclosure can be applied to the imaging unit 11402 among the configurations described above. By applying the technology according to the present disclosure to the imaging unit 11402, detection accuracy is improved.
[0146] Although an endoscopic surgery system has been described here as an example, the technology disclosed herein may also be applied to other systems, such as a microsurgery system.
[0147] <Applications to moving objects> The technology according to the present disclosure can be applied to various products. For example, the technology according to the present disclosure may be realized as a device mounted on any type of moving body such as an automobile, an electric vehicle, a hybrid electric vehicle, a motorcycle, a bicycle, a personal mobility device, an airplane, a drone, a ship, a robot, a construction machine, an agricultural machine (tractor), etc.
[0148] FIG. 26 is a block diagram showing a schematic configuration example of a vehicle control system, which is an example of a moving object control system to which the technology according to the present disclosure can be applied.
[0149] The vehicle control system 12000 includes a plurality of electronic control units connected via a communication network 12001. In the example shown in Fig. 26, the vehicle control system 12000 includes a drive system control unit 12010, a body system control unit 12020, an outside-vehicle information detection unit 12030, an inside-vehicle information detection unit 12040, and an integrated control unit 12050. Also, as functional configurations of the integrated control unit 12050, a microcomputer 12051, an audio / video output unit 12052, and an in-vehicle network I / F (interface) 12053 are illustrated.
[0150] The drivetrain control unit 12010 controls the operation of devices related to the drivetrain of the vehicle in accordance with various programs. For example, the drivetrain control unit 12010 functions as a control device for a drive force generating device for generating a drive force of the vehicle, such as an internal combustion engine or a drive motor, a drive force transmission mechanism for transmitting the drive force to the wheels, a steering mechanism for adjusting the steering angle of the vehicle, and a braking device for generating a braking force of the vehicle.
[0151] The body system control unit 12020 controls the operation of various devices mounted on the vehicle body according to various programs. For example, the body system control unit 12020 functions as a control device for a keyless entry system, a smart key system, a power window device, or various lamps such as head lamps, back lamps, brake lamps, turn signals, and fog lamps. In this case, radio waves or signals of various switches transmitted from a portable device that replaces a key may be input to the body system control unit 12020. The body system control unit 12020 receives the input of these radio waves or signals and controls the door lock device, power window device, lamps, and the like of the vehicle.
[0152] The outside-vehicle information detection unit 12030 detects information outside the vehicle equipped with the vehicle control system 12000. For example, an imaging unit 12031 is connected to the outside-vehicle information detection unit 12030. The outside-vehicle information detection unit 12030 causes the imaging unit 12031 to capture an image outside the vehicle and receives the captured image. The outside-vehicle information detection unit 12030 may perform object detection processing or distance detection processing for a person, a car, an obstacle, a sign, or characters on a road surface, based on the received image.
[0153] The imaging unit 12031 is an optical sensor that receives light and outputs an electrical signal according to the amount of light received. The imaging unit 12031 can output the electrical signal as an image, or as distance measurement information. The light received by the imaging unit 12031 may be visible light or invisible light such as infrared light.
[0154] The in-vehicle information detection unit 12040 detects information inside the vehicle. For example, a driver state detection unit 12041 that detects the state of the driver is connected to the in-vehicle information detection unit 12040. The driver state detection unit 12041 includes, for example, a camera that captures an image of the driver, and the in-vehicle information detection unit 12040 may calculate the degree of fatigue or concentration of the driver based on the detection information input from the driver state detection unit 12041, or may determine whether the driver is dozing.
[0155] The microcomputer 12051 can calculate control target values for the driving force generating device, the steering mechanism, or the braking device based on the information inside and outside the vehicle acquired by the outside-of-vehicle information detection unit 12030 or the inside-vehicle information detection unit 12040, and output a control command to the drive system control unit 12010. For example, the microcomputer 12051 can perform cooperative control aimed at realizing the functions of an ADAS (Advanced Driver Assistance System), including vehicle collision avoidance or impact mitigation, following driving based on the inter-vehicle distance, vehicle speed maintenance driving, vehicle collision warning, vehicle lane departure warning, etc.
[0156] In addition, the microcomputer 12051 can perform cooperative control for the purpose of autonomous driving, which allows the vehicle to travel autonomously without relying on the driver's operation, by controlling the driving force generating device, steering mechanism, braking device, etc. based on information about the surroundings of the vehicle acquired by the outside vehicle information detection unit 12030 or the inside vehicle information detection unit 12040.
[0157] Furthermore, the microcomputer 12051 can output a control command to the body system control unit 12020 based on the information outside the vehicle acquired by the outside-vehicle information detection unit 12030. For example, the microcomputer 12051 can control the headlamps according to the position of a preceding vehicle or an oncoming vehicle detected by the outside-vehicle information detection unit 12030, and perform cooperative control for the purpose of preventing glare, such as switching from high beams to low beams.
[0158] The audio / video output unit 12052 transmits at least one output signal of audio and video to an output device capable of visually or audibly notifying information to passengers in the vehicle or the outside of the vehicle. In the example of Fig. 26, an audio speaker 12061, a display unit 12062, and an instrument panel 12063 are exemplified as the output device. The display unit 12062 may include at least one of an on-board display and a head-up display, for example.
[0159] FIG. 27 is a diagram showing an example of the installation position of the imaging unit 12031.
[0160] In FIG. 27, the imaging unit 12031 includes imaging units 12101, 12102, 12103, 12104, and 12105.
[0161] The imaging units 12101, 12102, 12103, 12104, and 12105 are provided at positions such as the front nose, side mirrors, rear bumper, back door, and the upper part of the windshield inside the vehicle cabin of the vehicle 12100. The imaging unit 12101 provided at the front nose and the imaging unit 12105 provided at the upper part of the windshield inside the vehicle cabin mainly acquire images of the front of the vehicle 12100. The imaging units 12102 and 12103 provided at the side mirrors mainly acquire images of the sides of the vehicle 12100. The imaging unit 12104 provided at the rear bumper or back door mainly acquires images of the rear of the vehicle 12100. The imaging unit 12105 provided at the upper part of the windshield inside the vehicle cabin is mainly used to detect a preceding vehicle, a pedestrian, an obstacle, a traffic light, a traffic sign, a lane, or the like.
[0162] 27 shows an example of the imaging ranges of the imaging units 12101 to 12104. Imaging range 12111 indicates the imaging range of the imaging unit 12101 provided on the front nose, imaging ranges 12112 and 12113 indicate the imaging ranges of the imaging units 12102 and 12103 provided on the side mirrors, respectively, and imaging range 12114 indicates the imaging range of the imaging unit 12104 provided on the rear bumper or back door. For example, an overhead image of the vehicle 12100 viewed from above is obtained by superimposing the image data captured by the imaging units 12101 to 12104.
[0163] At least one of the imaging units 12101 to 12104 may have a function of acquiring distance information. For example, at least one of the imaging units 12101 to 12104 may be a stereo camera made up of a plurality of imaging elements, or may be an imaging element having pixels for detecting a phase difference.
[0164] For example, the microcomputer 12051 can extract, as a preceding vehicle, a three-dimensional object that is the closest three-dimensional object on the travel path of the vehicle 12100 and travels at a predetermined speed (for example, 0 km / h or more) in approximately the same direction as the vehicle 12100, by calculating the distance to each three-dimensional object in the imaging ranges 12111 to 12114 and the change over time of this distance (relative speed with respect to the vehicle 12100) based on the distance information obtained from the imaging units 12101 to 12104. Furthermore, the microcomputer 12051 can set a vehicle distance to be secured in advance in front of the preceding vehicle, and perform automatic brake control (including follow-up stop control) and automatic acceleration control (including follow-up start control). In this way, cooperative control can be performed for the purpose of automatic driving that travels autonomously without relying on the driver's operation.
[0165] For example, the microcomputer 12051 classifies and extracts three-dimensional object data on three-dimensional objects into two-wheeled vehicles, ordinary vehicles, large vehicles, pedestrians, utility poles, and other three-dimensional objects based on distance information obtained from the imaging units 12101 to 12104, and can use the data for automatic obstacle avoidance. For example, the microcomputer 12051 distinguishes obstacles around the vehicle 12100 into obstacles that are visible to the driver of the vehicle 12100 and obstacles that are difficult to see. Then, the microcomputer 12051 determines a collision risk indicating the risk of collision with each obstacle, and when the collision risk is equal to or greater than a set value and a collision is possible, the microcomputer 12051 can provide driving assistance for collision avoidance by outputting an alarm to the driver via the audio speaker 12061 or the display unit 12062, or by performing forced deceleration or avoidance steering via the drive system control unit 12010.
[0166] At least one of the imaging units 12101 to 12104 may be an infrared camera that detects infrared rays. For example, the microcomputer 12051 can recognize a pedestrian by determining whether or not a pedestrian is present in the captured images of the imaging units 12101 to 12104. The recognition of such a pedestrian is performed, for example, by a procedure of extracting feature points in the captured images of the imaging units 12101 to 12104 as infrared cameras, and a procedure of performing pattern matching processing on a series of feature points that indicate the contour of an object to determine whether or not the object is a pedestrian. When the microcomputer 12051 determines that a pedestrian is present in the captured images of the imaging units 12101 to 12104 and recognizes the pedestrian, the audio / image output unit 12052 controls the display unit 12062 to superimpose a rectangular contour line for emphasis on the recognized pedestrian. The audio / image output unit 12052 may also control the display unit 12062 to display an icon or the like indicating a pedestrian at a desired position.
[0167] An example of a vehicle control system to which the technology according to the present disclosure can be applied has been described above. The technology according to the present disclosure can be applied to the imaging unit 12031 among the above-described configurations. By applying the technology according to the present disclosure to the imaging unit 12031, it is possible to obtain a captured image that is easier to see, thereby reducing the fatigue of the driver.
[0168] In addition to the above, the technology according to the present disclosure can also be applied to other fields such as the field of factory automation (FA).
[0169] Although the contents of the present disclosure have been described above by way of embodiments and modified examples, the contents of the present disclosure are not limited to the above-mentioned embodiments and can be modified in various ways. For example, the layer structure of the imaging element described in the above-mentioned embodiment is an example, and other layers may be further included. Furthermore, the material and thickness of each layer are also an example, and are not limited to those described above.
[0170] In addition, in the above embodiment and the like, the photoelectric conversion film 13 includes a compound semiconductor material, but the photoelectric conversion film 13 may be made of other materials. For example, the photoelectric conversion film 13 may include an organic semiconductor material or quantum dots.
[0171] Furthermore, the circuit configurations described in the above embodiments are merely examples, and the configurations and arrangements thereof are not limited to those described above.
[0172] The effects described in the above embodiment and the like are merely examples, and other effects may be achieved, or further other effects may be included.
[0173] The present disclosure may be configured as follows. (1) A photoelectric conversion film provided across a plurality of pixels; A first electrode electrically connected to the photoelectric conversion film and provided for each pixel; a second electrode facing the first electrode with the photoelectric conversion film therebetween; a first charge accumulation section that accumulates signal charges generated in the photoelectric conversion film and transferred via the first electrode; A reset transistor provided for each pixel and configured to apply a reset potential to the first charge storage unit; a potential generating unit that applies a potential VPD to the first electrode of at least a portion of the plurality of pixels during a period in which the signal charges are accumulated in the first charge accumulating unit, the potential VPD making a potential difference between the first electrode and the second electrode smaller than the reset potential; A solid-state imaging element comprising: (2) The potential generating unit is connected to the first electrode via the reset transistor. The solid-state imaging device according to (1) above. (3) The potential generating unit includes a first transistor. The solid-state imaging device according to (1) above. (4) The first transistor is connected to the potential VPD, and is connected in parallel with the reset transistor between the first electrode and the reset transistor. The solid-state imaging device according to (3) above. (5) The first transistor is configured to be in an on state during the period. The solid-state imaging device according to (4) above. (6) The first transistor is connected in series to the first charge storage portion between the first electrode and the first charge storage portion. The solid-state imaging device according to (3) above. (7) The first transistor is configured to be in an off state during the period. The solid-state imaging device according to (6) above. (8) The potential generating section includes a second charge accumulation section provided for each pixel between the first electrode and the first charge accumulation section, and a second transistor provided between the second charge accumulation section and the first charge accumulation section. The solid-state imaging device according to (1) above. (9) The second transistor is configured to be in an off state during the period. The solid-state imaging device according to (8) above. (10) Further, a control line for selecting the pixel to which the potential VPD is applied to the first electrode is included. The solid-state imaging device according to any one of (1) to (9) above. (11) The plurality of pixels are arranged along a first direction and a second direction intersecting the first direction, The control line is provided along at least one of the first direction and the second direction. The solid-state imaging device according to (10) above. (12) a third transistor for capacitance switching connected to the first charge storage unit of a pixel other than the pixel to which the potential VPD is applied to the first electrode; an additional capacitance element connected to the third transistor; The solid-state imaging device according to (1) above. (13) The photoelectric conversion film includes a compound semiconductor, an organic semiconductor, or a quantum dot. The solid-state imaging device according to any one of (1) to (12) above. (14) The signal charge generated in the photoelectric conversion film of the pixel to which the potential VPD is applied is transferred to the first charge storage section of the other pixels. The solid-state imaging device according to any one of (1) to (13) above. (15) A photoelectric conversion film provided across a plurality of pixels; A first electrode electrically connected to the photoelectric conversion film and provided for each pixel; a second electrode facing the first electrode with the photoelectric conversion film therebetween; a first charge accumulation section that accumulates signal charges generated in the photoelectric conversion film and transferred via the first electrode; A reset transistor provided for each pixel and configured to apply a reset potential to the first charge storage unit; a potential generating unit that applies a potential VPD to the first electrode of at least a part of the plurality of pixels during a period in which the signal charges are accumulated in the first charge accumulating unit, the potential VPD making a potential difference between the first electrode and the second electrode smaller than the reset potential. An imaging device having a solid-state imaging element.
[0174] This application claims priority based on Japanese Patent Application No. 2018-20098 filed on February 7, 2018, and Japanese Patent Application No. 2018-34466 filed on February 28, 2018 in the Japan Patent Office, the entire contents of which are incorporated herein by reference.
[0175] Those skilled in the art will recognize that various modifications, combinations, subcombinations, and variations may occur to those skilled in the art depending on design requirements and other factors, and that such modifications are within the scope of the appended claims and their equivalents.
Claims
1. A photoelectric conversion film provided across a plurality of pixels; A first electrode electrically connected to the photoelectric conversion film and provided for each pixel; a second electrode facing the first electrode with the photoelectric conversion film therebetween; a first charge storage section capable of storing signal charges generated in the photoelectric conversion film and transferred via the first electrode; a reset transistor provided for each pixel and capable of applying a reset potential to the first charge accumulation unit; a potential generating section electrically connected to the first electrodes of at least some of the pixels via the reset transistors, the potential generating section being capable of generating a potential VPD different from the reset potential; Equipped with The signal charge generated in the photoelectric conversion film of the pixel to which the potential VPD is applied is transferred to the first charge storage section of the other pixels. Solid-state imaging element.
2. The potential generating section is capable of applying the potential VPD to the first electrodes of at least some of the pixels via the reset transistors. The solid-state imaging device according to claim 1 .
3. The potential generating section is capable of applying the potential VPD to the first electrodes of at least some of the pixels during a period in which the signal charges are accumulated in the first charge accumulating section. The solid-state imaging device according to claim 1 .
4. the plurality of pixels include read pixels and non-read pixels, The potential generating section is capable of applying the potential VPD to the first electrodes of the non-read pixels. The solid-state imaging device according to claim 1 .
5. the reset transistor is electrically connected to the first charge storage unit and the first electrode, The potential generating unit is electrically connected to the first charge accumulating unit and the first electrode via the reset transistor. The solid-state imaging device according to claim 1 .
6. The potential generating unit is capable of generating the reset potential and the potential VPD. The solid-state imaging device according to claim 1 .
7. The reset transistor is capable of applying the reset potential generated by the potential generating unit to the first charge storage unit. The solid-state imaging device according to claim 6 .
8. Further, a control line for selecting the pixel to which the potential VPD is applied to the first electrode is included. The solid-state imaging device according to claim 1 .
9. The plurality of pixels are arranged along a first direction and a second direction intersecting the first direction, The control line is provided along at least one of the first direction and the second direction. The solid-state imaging device according to claim 8 .
10. a third transistor for capacitance switching connected to the first charge storage unit of a pixel other than the pixel to which the potential VPD is applied to the first electrode; an additional capacitance element connected to the third transistor; The solid-state imaging device according to claim 1 .
11. The photoelectric conversion film includes a compound semiconductor, an organic semiconductor, or a quantum dot. The solid-state imaging device according to claim 1 .
12. A photoelectric conversion film provided across a plurality of pixels; A first electrode electrically connected to the photoelectric conversion film and provided for each pixel; a second electrode facing the first electrode with the photoelectric conversion film therebetween; a first charge storage section capable of storing signal charges generated in the photoelectric conversion film and transferred via the first electrode; a reset transistor provided for each pixel and capable of applying a reset potential to the first charge accumulation unit; a potential generating unit electrically connected to the first electrodes of at least some of the pixels via the reset transistor, the potential generating unit being capable of generating a potential VPD different from the reset potential; The signal charge generated in the photoelectric conversion film of the pixel to which the potential VPD is applied is transferred to the first charge storage section of the other pixels. An imaging device having a solid-state imaging element.
Citation Information
Patent Citations
Imaging apparatus, and method of driving solid state imaging element
JP2010016594A
Imaging device
JP2017135703A
Imaging device and driving method therefor
WO2014103169A1
Solid-state imaging element
WO2017150167A1
