Optical detection devices, optical detection systems and electronic equipment

By employing photoelectric conversion elements and readout circuits in the optical detection device, the compatibility issues of photoelectric conversion and signal readout during miniaturization are resolved, achieving efficient photoelectric signal processing suitable for electronic devices such as digital cameras, camcorders, and mobile phones.

CN123125892APending Publication Date: 2026-11-17SONY SEMICON SOLUTIONS CORP
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202580028961.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2024-06-07
Filing Date
2025-04-16
Publication Date
2026-11-17

AI Technical Summary

Technical Problem

Existing photodetectors face challenges in miniaturization, struggling to achieve both efficient photoelectric conversion and signal readout.

Method used

The system employs first and second photoelectric conversion elements, each with a photoelectric conversion film, and is connected to a floating diffuser via a readout circuit. It utilizes transistors to output charge signals and perform AD conversion, and combines the AD conversion circuit to generate digital signals.

Benefits of technology

It achieves efficient photoelectric conversion and signal readout, supports miniaturized photodetector devices, and is suitable for various electronic devices.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN123125892A_ABST
    Figure CN123125892A_ABST
Patent Text Reader

Abstract

A light detection device according to one embodiment of this disclosure includes: a first photoelectric conversion element and a second photoelectric conversion element, each photoelectric conversion element having a photoelectric conversion film for performing photoelectric conversion of light; and a readout circuit including a first floating diffuser electrically connected to the first photoelectric conversion element and a second floating diffuser electrically connected to the second photoelectric conversion element, and capable of outputting a signal based on charge accumulated in the first floating diffuser. The readout circuit includes a first transistor capable of electrically connecting the first floating diffuser and the second floating diffuser.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to a light detection device, a light detection system, and an electronic device. Background Technology

[0002] An imaging device has been proposed that includes a phase difference pixel having two photoelectric conversion sections, two charge retention sections, and two MOS transistors used as switching elements (Patent Document 1).

[0003] Citation List

[0004] Patent documents

[0005] Patent Document 1: Japanese Patent Application Publication No. 2016-58559 Summary of the Invention

[0006] The goal is to develop a light detection device that is compatible with miniaturization.

[0007] There is a demand for optical detection devices that facilitate miniaturization.

[0008] The light detection device according to an embodiment of this disclosure includes: a first photoelectric conversion element and a second photoelectric conversion element, each photoelectric conversion element having a photoelectric conversion film for performing photoelectric conversion of light; and a readout circuit including a first floating diffuser electrically connected to the first photoelectric conversion element and a second floating diffuser electrically connected to the second photoelectric conversion element, and capable of outputting a signal based on charge accumulated in the first floating diffuser. The readout circuit includes a first transistor capable of electrically connecting the first floating diffuser and the second floating diffuser.

[0009] The optical detection system according to an embodiment of this disclosure includes an optical detection device and a computing device. The optical detection device includes: a first photoelectric conversion element and a second photoelectric conversion element, each having a photoelectric conversion film that performs photoelectric conversion on light; a readout circuit including a first floating diffuser electrically connected to the first photoelectric conversion element and a second floating diffuser electrically connected to the second photoelectric conversion element, and capable of outputting a signal based on the charge accumulated in the first floating diffuser; and an AD conversion circuit capable of performing AD conversion. The readout circuit includes a first transistor electrically connected to the first and second floating diffusers, and capable of outputting a first signal based on the charge converted by the first photoelectric conversion element and a second signal based on the charge converted by the first and second photoelectric conversion elements. The computing device is capable of generating a third signal based on the charge converted by the second photoelectric conversion element based on the first and second signals converted into digital signals by the AD conversion circuit.

[0010] An electronic device according to an embodiment of this disclosure includes: a first photoelectric conversion element and a second photoelectric conversion element, each photoelectric conversion element having a photoelectric conversion film for performing photoelectric conversion of light; and a readout circuit including a first floating diffuser electrically connected to the first photoelectric conversion element and a second floating diffuser electrically connected to the second photoelectric conversion element, and capable of outputting a signal based on charge accumulated in the first floating diffuser. The readout circuit includes a first transistor capable of electrically connecting the first floating diffuser and the second floating diffuser. Attached Figure Description

[0011] Figure 1 This is a block diagram illustrating an example of the schematic configuration of an imaging apparatus, which is an example of a light detection device according to an embodiment of the present disclosure.

[0012] Figure 2 This is a diagram showing an example of the pixel portion of an imaging apparatus according to an embodiment of the present disclosure.

[0013] Figure 3 This is a diagram illustrating an example of the cross-sectional configuration of an imaging apparatus according to an embodiment of the present disclosure.

[0014] Figure 4 This is a diagram illustrating an example of the circuit configuration of the pixels of an imaging apparatus according to an embodiment of the present disclosure.

[0015] Figure 5 This is a diagram illustrating an example of the configuration of an imaging apparatus according to an embodiment of the present disclosure.

[0016] Figure 6 This is a diagram illustrating an operational example of an imaging apparatus according to an embodiment of the present disclosure.

[0017] Figure 7 This is a timing diagram illustrating an operational example of an imaging apparatus according to an embodiment of the present disclosure.

[0018] Figure 8 This is a timing diagram illustrating an operational example of an imaging apparatus according to an embodiment of the present disclosure.

[0019] Figure 9 This is a diagram illustrating another example of the cross-sectional configuration of an imaging apparatus according to an embodiment of the present disclosure.

[0020] Figure 10 This is a diagram illustrating another example of the circuit configuration of the pixels of an imaging apparatus according to an embodiment of the present disclosure.

[0021] Figure 11 This is a diagram illustrating an example of the configuration of an imaging apparatus according to a variation of this disclosure, 1.

[0022] Figure 12This is a diagram illustrating an example of the configuration of an imaging apparatus according to a variation of this disclosure, 1.

[0023] Figure 13 This is a diagram illustrating an example of the planar configuration of an imaging apparatus according to a variation of the present disclosure, 1.

[0024] Figure 14 This is a diagram illustrating an example of the pixel configuration of an imaging apparatus according to a modified example 2 of this disclosure.

[0025] Figure 15 This is a diagram illustrating an example of the pixel configuration of an imaging apparatus according to Modification 3 of this disclosure.

[0026] Figure 16 This is a diagram illustrating an example of the pixel configuration of an imaging apparatus according to Modification 3 of this disclosure.

[0027] Figure 17 This is a diagram illustrating an example of the pixel configuration of an imaging apparatus according to Modification 4 of this disclosure.

[0028] Figure 18 This is a diagram illustrating an example of the pixel configuration of an imaging apparatus according to Modification 4 of this disclosure.

[0029] Figure 19 This is a diagram illustrating an example of the pixel configuration of an imaging apparatus according to Modification 5 of this disclosure.

[0030] Figure 20 This is a diagram illustrating an example of the pixel configuration of an imaging apparatus according to Modification 5 of this disclosure.

[0031] Figure 21 This is a diagram illustrating an example of the pixel configuration of an imaging apparatus according to Modification 5 of this disclosure.

[0032] Figure 22 This is a diagram illustrating an example of the pixel configuration of an imaging apparatus according to Modification 5 of this disclosure.

[0033] Figure 23 This is a diagram illustrating an example of the pixel configuration of an imaging apparatus according to Modification 5 of this disclosure.

[0034] Figure 24 This is a diagram illustrating an example of the pixel configuration of an imaging apparatus according to Modification 5 of this disclosure.

[0035] Figure 25 This is a diagram illustrating an example of the configuration of an imaging apparatus according to Modification 6 of this disclosure.

[0036] Figure 26 This is a diagram illustrating an example of the configuration of an imaging apparatus according to Modification 6 of this disclosure.

[0037] Figure 27 This is a diagram illustrating an example of the configuration of an imaging apparatus according to Modification 6 of this disclosure.

[0038] Figure 28 This is a timing diagram showing an operation example of the imaging apparatus according to Modification 7 of this disclosure.

[0039] Figure 29 This is a diagram illustrating a configuration example of an imaging apparatus according to Modification 8 of this disclosure.

[0040] Figure 30 This is a diagram illustrating a configuration example of an imaging apparatus according to Modification 8 of this disclosure.

[0041] Figure 31 This is a diagram illustrating an example of the configuration of an imaging apparatus according to Modification 9 of this disclosure.

[0042] Figure 32 This is a timing diagram showing an operation example of the imaging apparatus according to Modification 9 of this disclosure.

[0043] Figure 33A This is a diagram illustrating an example of the configuration of an imaging apparatus according to a variation 10 of this disclosure.

[0044] Figure 33B This is a diagram illustrating an example of the configuration of an imaging apparatus according to a variation 10 of this disclosure.

[0045] Figure 34 This is a block diagram illustrating an example of the configuration of an electronic device.

[0046] Figure 35A An example of the overall configuration of a light detection system is shown schematically.

[0047] Figure 35B An example of the overall configuration of a light detection system is shown schematically.

[0048] Figure 36 This is a block diagram illustrating an example of the schematic configuration of a vehicle control system.

[0049] Figure 37 This is an example diagram illustrating the installation location of the vehicle exterior information detection unit and the imaging unit.

[0050] Figure 38 This is a block diagram illustrating an example of the schematic configuration of an endoscopic surgical system.

[0051] Figure 39 This is a block diagram illustrating an example of the functional configuration of a camera and a camera control unit (CCU). Detailed Implementation

[0052] The embodiments of this disclosure will be described in detail below with reference to the accompanying drawings. It should be noted that the descriptions are given in the following order.

[0053] 1. Implementation Plan

[0054] 2. Variations

[0055] 3. Applicable Examples

[0056] 4. Application Examples

[0057] <1. Implementation Plan>

[0058] Figure 1 This is a block diagram illustrating an example of the schematic configuration of an imaging apparatus, which is an example of a light detection device according to an embodiment of the present disclosure. Figure 2 This is a diagram illustrating an example of a pixel unit of an imaging apparatus according to an embodiment. A light detection device is a device capable of detecting incident light. The imaging apparatus 1, as a light detection device, includes a plurality of pixels PX, each pixel PX including a photoelectric conversion unit (photoelectric conversion element), and is configured to perform photoelectric conversion on the incident light to generate a signal. The imaging apparatus 1 can receive, for example, light transmitted through an optical system (not shown) including an optical lens to generate a signal.

[0059] Imaging device 1 includes, for example, a semiconductor substrate (e.g., a silicon substrate) having a plurality of pixels PX. Each pixel PX of imaging device 1 includes, for example, a photodiode (PD) as a photoelectric conversion unit, and is configured to perform photoelectric conversion of light. As... Figure 2 As shown in the example, the imaging device 1 has an imaging region (pixel section 100) in which multiple pixels PX are arranged in a matrix in a two-dimensional configuration. The pixel section 100 can be referred to as a pixel array in which multiple pixels PX are arranged.

[0060] Imaging device 1 receives incident light (image light) from a subject being measured via an optical system including optical lenses. Imaging device 1 captures an image of the subject formed by the optical lenses. Imaging device 1 can perform photoelectric conversion on the received light (e.g., visible light, infrared light, etc.) and generate pixel signals. As a light detection device, imaging device 1 is a device capable of receiving incident light and generating signals, and can be referred to as a light receiving device.

[0061] As an example, the imaging device 1 (light detection device) can be configured as an image sensor. Imaging device 1 is, for example, a complementary metal-oxide-semiconductor (CMOS) image sensor. Imaging device 1 can have a structure in which multiple semiconductor layers are stacked on top of each other (stacked structure). Imaging device 1 can be used in various electronic devices, such as digital cameras, camcorders, and mobile phones.

[0062] Note that, as Figure 2As shown, the direction of light entering from the subject is defined as the Z-axis direction, the left and right sides of the plane orthogonal to the Z-axis direction are defined as the X-axis direction, and the up and down directions of the plane orthogonal to both the Z-axis and X-axis directions are defined as the Y-axis direction. The accompanying figures referenced in the following description can be seen... Figure 2 The arrows in the diagram indicate the direction.

[0063] As an example, such as Figure 1 As shown, the imaging device 1 includes a pixel unit 100 (pixel array), a vertical drive circuit 111, a signal processing circuit 112, a horizontal drive circuit 113, an output circuit 114, a control circuit 115, and an input / output terminal 116. Furthermore, the imaging device 1 is provided with, for example, multiple control lines L1 and multiple signal lines L2.

[0064] Control line L1 is a signal line capable of transmitting signals for controlling pixel PX, and is connected to the vertical drive circuit 111 and the pixel PX of the pixel unit 100. Figure 1 In the example shown, multiple control lines L1 are wired in the pixel section 100 for each pixel row comprising a plurality of pixels PX arranged in the horizontal direction (row direction). The control lines L1 are configured to transmit control signals for reading signals from the pixels PX.

[0065] As an example, the multiple control lines L1 for each pixel row of the imaging device 1 include wiring for transmitting signals to control the transmission transistor, wiring for transmitting signals to control the selection transistor, and wiring for transmitting signals to control the reset transistor, etc. The control lines L1 can be referred to as driving lines (pixel driving lines) for transmitting signals to drive pixels PX.

[0066] Signal line L2 is a signal line capable of transmitting signals from pixel PX and is connected to pixel PX and signal processing circuit 112 of pixel unit 100. In pixel unit 100, for example, one or more signal lines L2 are wired for each pixel column including multiple pixels PX arranged in the vertical direction (column direction).

[0067] Signal line L2 is a vertical signal line and is designed to transmit the signal output from pixel PX. In imaging apparatus 1, multiple signal lines L2 can be provided for a single pixel column. Imaging apparatus 1 may include multiple signal lines L2 for each pixel column.

[0068] The vertical drive circuit 111 is configured to drive each pixel PX of the pixel unit 100. The vertical drive circuit 111 includes, for example, multiple circuits, including a buffer, a shift register, an address decoder, etc. The vertical drive circuit 111 generates signals for driving the pixels PX and outputs these signals to each pixel PX of the pixel unit 100 via control line L1. The vertical drive circuit 111 is controlled by the control circuit 115 and performs control over the pixels PX of the pixel unit 100.

[0069] The vertical drive circuit 111 generates signals for controlling pixels PX, such as signals for controlling the selection transistor of pixel PX or signals for controlling the reset transistor, and supplies these signals to each pixel PX via control line L1. The vertical drive circuit 111 can perform control of reading pixel signals from each pixel PX. The vertical drive circuit 111 can also be referred to as a pixel control unit configured to control each pixel PX.

[0070] The signal processing circuit 112 is configured to perform signal processing on signals input to the pixel. The signal processing circuit 112 includes, for example, a load circuit, an analog-to-digital (AD) conversion circuit, a level selection switch, etc. As an example, the load circuit includes a current source configured to supply current to the amplifying transistor of the pixel PX. For example, the load circuit and the amplifying transistor of the pixel PX together form a source follower circuit.

[0071] The signal processing circuit 112 may include an amplifier circuit configured to amplify the signal read from the pixel PX via the signal line L2. For example, a load circuit, an amplifier circuit, an AD conversion circuit, etc., may be provided for each of the multiple signal lines L2. The load circuit, amplifier circuit, AD conversion circuit, etc., may be provided for each pixel column of the pixel section 100.

[0072] The signals output from each pixel PX selected and scanned by the vertical drive circuit 111 are input to the signal processing circuit 112 via signal line L2. The signal processing circuit 112 can perform signal processing on the signals of the pixel PX, such as AD conversion and CDS (correlated double sampling).

[0073] The horizontal drive circuit 113 includes, for example, a buffer, a shift register, an address decoder, etc. The horizontal drive circuit 113 is configured to drive the horizontal selection switches of the signal processing circuit 112. While scanning the horizontal selection switches, the horizontal drive circuit 113 sequentially drives each horizontal selection switch of the signal processing circuit 112. The signals of each pixel PX transmitted through each signal line L2 are processed by the signal processing circuit 112, and the selective scan performed by the horizontal drive circuit 113 sequentially outputs them to the horizontal signal line 121.

[0074] Output circuit 114 is configured to perform signal processing on the input signal and output the signal. Output circuit 114 performs signal processing on the pixel signals sequentially input from signal processing circuit 112 via horizontal signal line 121 and outputs the processed pixel signals. Output circuit 114 can perform, for example, buffering, black level adjustment, column change correction, and various digital signal processing.

[0075] The control circuit 115 is configured to control the various units of the imaging device 1. The control circuit 115 can receive data such as clock signals and instruction operation modes supplied from an external source, and output data such as internal information about the imaging device 1. The control circuit 115 includes, for example, a timing generator configured to generate various timing signals.

[0076] The control circuit 115 controls the driving of peripheral circuits such as the vertical drive circuit 111, the signal processing circuit 112, and the horizontal drive circuit 113 based on various timing signals (pulse signals, clock signals, etc.) generated by the timing generator. The input / output terminal 116 exchanges signals with the outside.

[0077] Note that the vertical drive circuit 111, signal processing circuit 112, horizontal drive circuit 113, horizontal signal line 121, output circuit 114, control circuit 115, etc., can be disposed on a single semiconductor substrate, or can be disposed separately on multiple semiconductor substrates. The imaging device 1 can have a structure in which multiple substrates are stacked (stacked structure).

[0078] Figure 3 This is a diagram illustrating an example of the cross-sectional configuration of the imaging device according to an embodiment. Furthermore, Figure 4 This is a diagram illustrating an example of the circuit configuration of the pixels in an imaging apparatus according to an embodiment. (Similar to...) Figure 3 As shown in the example, the imaging device 1 includes, for example, a light receiving layer 20, a wiring layer 130, a semiconductor layer 110, and a wiring layer 120. The imaging device 1 has a configuration in which the light receiving layer 20, the wiring layer 130, the semiconductor layer 110, and the wiring layer 120 are stacked in the Z-axis direction.

[0079] The pixel PX of the imaging device 1 includes multiple photoelectric conversion units 11 ( Figure 3 The photoelectric conversion units 11a and 11b in the imaging device 1 are described. The photoelectric conversion unit 11 (photoelectric conversion element) is configured to receive light and generate a signal. For example, in each pixel PX of the imaging device 1, a plurality of photoelectric conversion units 11 are arranged adjacent to each other.

[0080] exist Figure 3 and Figure 4In the example shown, pixel PX includes photoelectric conversion unit 11a and photoelectric conversion unit 11b. Photoelectric conversion unit 11b is disposed adjacent to photoelectric conversion unit 11a. Both photoelectric conversion units 11a and 11b include a photoelectric conversion film 22 and are configured to generate charge through photoelectric conversion. Alternatively, a pixel including photoelectric conversion unit 11a and a pixel including photoelectric conversion unit 11b can be provided.

[0081] Note that, for ease of explanation, in situations such as Figure 4 In the circuit diagram, the photoelectric conversion unit 11 is represented by the symbol of a diode used as a photodiode, and an example of holes being read out as charge carriers to the floating diffusion unit is schematically shown. However, the diode connection relationship (i.e., the connection relationship between the photoelectric conversion units 11) is not limited to the example shown, and can be appropriately determined according to the charge carriers (signal charges).

[0082] like Figure 3 As shown, semiconductor layer 110 has opposing surfaces 11S1 and 11S2. Surface 11S2 of semiconductor layer 110 is the side opposite to surface 11S1. Semiconductor layer 110 includes a semiconductor substrate, or, for example, a silicon (Si) substrate.

[0083] Note that the semiconductor layer 110 can be a silicon-on-insulator (SOI) substrate, a silicon-germanium (SiGe) substrate, a silicon carbide (SiC) substrate, etc., and can be formed using some other semiconductor materials. The semiconductor layer 110 can contain III-V group compound semiconductor materials, etc.

[0084] Surface 11S1 of semiconductor layer 110 is a light-receiving surface (light-incident surface). Surface 11S2 of semiconductor layer 110 is a component forming surface on which components such as transistors are formed. Gate electrodes, gate insulating films (e.g., gate oxide films), etc., are disposed on surface 11S2 of semiconductor layer 110. Note that surface 11S2 is a surface on which various circuit elements such as transistors, capacitors, or resistors are disposed, and can also be referred to as a circuit surface.

[0085] exist Figure 3 In the example shown, the light receiving layer 20 and the wiring layer 130 are disposed on the surface 11S1 side of the semiconductor layer 110. The wiring layer 120 is disposed on the surface 11S2 side of the semiconductor layer 110. The lens 91, the light receiving layer 20, etc. are disposed on the side where light from the optical system is incident, and the wiring layer 120 is disposed on the side opposite to the side where light is incident.

[0086] Wiring layer 120 includes, for example, a conductive film and an insulating film, and has multiple wires, through-holes, etc. Wiring layer 120 is a multilayer wiring layer, and includes, for example, two or more layers of wiring. Wiring layer 120 has a configuration in which multiple wires are separated by insulating film layers that serve as interlayer insulating films (interlayer insulating layers).

[0087] The wiring of wiring layer 120 is formed using metal materials such as aluminum (Al), tungsten (W), or copper (Cu). The wiring of wiring layer 120 can be formed using polysilicon (Poly-Si) or some other conductive materials. The interlayer insulating film is formed using materials such as silicon oxide (SiO), silicon nitride (SiN), or silicon oxynitride (SiON).

[0088] For example, in the semiconductor layer 110 and the wiring layer 120, a readout circuit 15 is provided for each pixel PX to output a signal for outputting charge based on photoelectric conversion (see reference). Figure 4 As an example, the transistors RST, AMP, SEL, FDA, and FDB of the readout circuit 15 are disposed on the surface 11S2 side of the semiconductor layer 110.

[0089] Note that the aforementioned vertical drive circuit 111, signal processing circuit 112, horizontal drive circuit 113, horizontal signal line 121, output circuit 114, control circuit 115, etc. (see reference) Figure 1 It can be disposed on a substrate different from the semiconductor layer 110, or disposed in the semiconductor layer 110 and the wiring layer 120.

[0090] Lens 91 is a light-collecting lens and is also known as an on-chip lens. Lens 91 is formed using materials such as silicon oxide, silicon nitride, and silicon oxynitride. Note that lens 91 can be formed using some other materials that transmit light. For example, for each pixel PX, lens 91 is positioned above photoelectric conversion units 11a and 11b.

[0091] Light from the object being measured is incident on lens 91 (lens section) via an optical system such as an imaging lens. Lens 91 guides the incident light toward photoelectric conversion units 11a and 11b. In the imaging device 1, both photoelectric conversion units 11a and 11b perform photoelectric conversion on the light entering through lens 91. Each of photoelectric conversion units 11a and 11b can absorb the incident light and generate an electric charge.

[0092] In the imaging device 1, for example, a single lens 91 is provided for the photoelectric conversion unit 11a and the photoelectric conversion unit 11b. In the imaging device 1, the photoelectric conversion unit 11a and the photoelectric conversion unit 11b receive light from different regions of an optical system such as an imaging lens, thereby performing pupil segmentation.

[0093] Phase difference data (phase difference information) can be obtained using signals based on the charge converted by photoelectric conversion unit 11a and signals based on the charge converted by photoelectric conversion unit 11b. Phase difference autofocus (AF) can be performed using the phase difference data. The pixel PX of the imaging device 1 is a pixel that can be used for phase difference detection, and can also be called a phase difference pixel (or phase difference detection pixel).

[0094] as Figure 3 As shown in the example, each pixel PX's photoelectric conversion section 11a and photoelectric conversion section 11b includes a photoelectric conversion film 22 and an upper electrode 23. Furthermore, photoelectric conversion section 11a includes a lower electrode 24a, and photoelectric conversion section 11b includes a lower electrode 24b. The photoelectric conversion sections 11a and 11b, including the photoelectric conversion film 22, can also each be referred to as photoelectric conversion regions.

[0095] The photoelectric conversion film 22 generates charge through photoelectric conversion. The photoelectric conversion film 22 can perform photoelectric conversion on incident light and generate a charge corresponding to the amount of light received. The photoelectric conversion film 22 can also be called a photoelectric conversion layer. The photoelectric conversion film 22 (photoelectric conversion layer) is, for example, a photoelectric conversion film containing organic materials.

[0096] For example, in imaging apparatus 1, each pixel PX is provided with a photoelectric conversion film 22 formed using an organic semiconductor material. Note that a photoelectric conversion film formed using an inorganic material can also be used as the photoelectric conversion film 22. The material of the photoelectric conversion film 22 can be selected, for example, according to the wavelength range of the incident light to be measured.

[0097] The upper electrode 23 is, for example, an electrode shared by the photoelectric conversion film 22 of multiple pixels PX, and is disposed on one side of the photoelectric conversion film 23. In each pixel PX, a lower electrode 24a and a lower electrode 24b are disposed for the photoelectric conversion film 22. For each pixel PX, the lower electrode 24a and the lower electrode 24b are disposed on the other side of the photoelectric conversion film 22. The lower electrodes 24a and 24b are electrodes used to read out the charge converted by the photoelectric conversion film 22.

[0098] exist Figure 3 In the example shown, the upper electrode 23 and the lower electrode 24a (or lower electrode 24b) are configured with a photoelectric conversion film 22 in between. Each of the lower electrodes 24a and 24b is configured to face the upper electrode 23 with a portion of the photoelectric conversion film 22 in between. The upper electrode 23 is the electrode above the photoelectric conversion film 22, and the lower electrodes 24a and 24b are the electrodes below the photoelectric conversion film 22.

[0099] The upper electrode 23 is a shared electrode for multiple pixels PX, and can also be called a shared electrode. The lower electrodes 24a and 24b can also be called readout electrodes. The upper electrode 23, the lower electrode 24a, and the lower electrode 24b are electrically connected to circuits disposed in the semiconductor layer 110 and the wiring layer 120, for example, via different wirings, electrodes, etc.

[0100] exist Figure 3 In the example shown, lower electrodes 24a and 24b are disposed in wiring layer 130. Wiring layer 130 is disposed on surface 11S1 of semiconductor layer 110. Wiring layer 130 includes, for example, a conductor film and an insulating film, and includes multiple wirings, electrodes, etc. Wiring layer 130 can be a multilayer wiring layer and can have a configuration of multiple stacked wirings.

[0101] The wiring layer 130 includes an insulating film, such as an oxide film, a nitride film, or an oxide oxynitride film, as an interlayer insulating film. For example, the insulating film of the wiring layer 130 can be formed using silicon oxide (SiO), silicon nitride (SiN), silicon oxynitride (SiON), etc., and can also be formed using some other materials that transmit the light to be measured.

[0102] The aforementioned upper electrode 23, lower electrode 24a, and lower electrode 24b are, for example, transparent electrodes, and may contain indium tin oxide (ITO), indium zinc oxide (IZO), tin oxide (SnO), zinc oxide (ZnO), etc. The upper electrode 23, lower electrode 24a, and lower electrode 24b may contain other metal oxides, or may be formed using other transparent conductive materials.

[0103] The upper electrode 23, lower electrode 24a, and lower electrode 24b can be formed using tin oxide-based materials, such as antimony-doped (Sb) tin oxide (ATO) or fluorine-doped (F) tin oxide-based materials (FTO). Alternatively, the upper electrode 23, lower electrode 24a, and lower electrode 24b can be formed using zinc oxide-based materials.

[0104] The upper electrode 23, lower electrode 24a, and lower electrode 24b may include, for example, zinc aluminum oxide (AZO), zinc gallium oxide (GZO), zinc indium oxide (IZO), zinc indium gallium oxide (IGZO), etc. Alternatively, the upper electrode 23, lower electrode 24a, and lower electrode 24b may be formed using CuI, InSbO4, ZnMgO, CuInO2, MgIn2O4, CdO, ZnSnO3, TiO2, spinel-type oxides, oxides having a YbFe2O4 structure, etc.

[0105] When transparency is not required, the upper electrode 23, lower electrode 24a, or lower electrode 24b may comprise, for example, alkali metals (such as lithium (Li), sodium (Na), or potassium (K)), alkaline earth metals (such as magnesium (Mg) or calcium (Ca)). Alternatively, the upper electrode 23, lower electrode 24a, or lower electrode 24b may be formed using metallic materials such as platinum (Pt), gold (Au), palladium (Pd), chromium (Cr), nickel (Ni), aluminum (Al), silver (Ag), tantalum (Ta), tungsten (W), copper (Cu), titanium (Ti), indium (In), tin (Sn), iron (Fe), cobalt (Co), or molybdenum (Mo).

[0106] The upper electrode 23, lower electrode 24a, and lower electrode 24b can be formed using conductive materials, such as polycrystalline silicon containing impurities, carbon-based materials, oxide semiconductors, carbon nanotubes, or graphene. Alternatively, the upper electrode 23, lower electrode 24a, and lower electrode 24b can be formed using organic materials (e.g., conductive polymers), such as poly(3,4-ethylenedioxythiophene) / polystyrene sulfonic acid [PEDOT / PSS].

[0107] The photoelectric conversion film 22 can absorb, for example, at least 60% of light with a predetermined wavelength included in the range from the visible light region to the near-infrared region, and perform charge separation. The photoelectric conversion film 22 absorbs some or all wavelengths of light in the visible light region and the near-infrared light region, for example, having wavelengths from 400 nm to less than 1300 nm. The photoelectric conversion film 22 contains, for example, two or more organic materials used as p-type semiconductors or n-type semiconductors, and has a junction surface (p / n junction surface) between the p-type semiconductor and the n-type semiconductor.

[0108] Furthermore, the photoelectric conversion film 22 can have a stacked structure comprising a layer containing a p-type semiconductor (p-type semiconductor layer) and a layer containing an n-type semiconductor (n-type semiconductor layer) (p-type semiconductor layer / n-type semiconductor layer), a stacked structure comprising a p-type semiconductor layer and a mixed layer of p-type and n-type semiconductors (bulk heterolayer), or a stacked structure comprising an n-type semiconductor and a bulk heterolayer (n-type semiconductor layer / bulk heterolayer). Alternatively, the photoelectric conversion film 22 can be formed using only a mixed layer of p-type and n-type semiconductors (bulk heterolayer).

[0109] For example, a p-type semiconductor is a hole transport material that is used relatively as an electron donor, and an n-type semiconductor is an electron transport material that is used relatively as an electron acceptor. For example, the photoelectric conversion film 22 provides a field in which excitons (electron-hole pairs) generated when light is absorbed are separated into electrons and holes, specifically, the electron-hole pairs are separated into electrons and holes at the interface (p / n junction) between the electron donor and the electron acceptor.

[0110] Examples of p-type semiconductors include, for example, naphthalene derivatives, anthracene derivatives, phenanthrene derivatives, pyrene derivatives, perylene derivatives, tetraphenylene derivatives, pentaphenylene derivatives, quinacridone derivatives, thiophene derivatives, thiophene-thiophene derivatives, benzothiophene derivatives, benzothiophene-benzothiophene (BTBT) derivatives, dinaphthothiophene-benzothiophene (DNTT) derivatives, dianthraphene-benzothiophene (DATT) derivatives, benzobisbenzothiophene (BBBT) derivatives, and thiophene-bisphenylene derivatives. Thiophene-based materials are represented by thiophene (TBBT) derivatives, dibenzothiophene-bisbenzothiophene (DBTBT) derivatives, dibenzothiophene-benzodithiophene (DTBDT) derivatives, dibenzothiophene-benzodithiophene (DBTDT) derivatives, benzodithiophene (BDT) derivatives, naphthiophene (NDT) derivatives, anthracene dithiophene (ADT) derivatives, tetrabenzodithiophene (TDT) derivatives, and pentabenzodithiophene (PDT) derivatives. Other examples of p-type semiconductors include triphenylamine derivatives, carbazole derivatives, styrene derivatives, benzothiazolinone derivatives, fluoranthene derivatives, phthalocyanine derivatives, phthalocyanine derivatives, porphyrin derivatives, metal complexes with heterocyclic compounds as ligands, polythiophene derivatives, polybenzothiadiazole derivatives, and polyfluorene derivatives.

[0111] Examples of n-type semiconductors include, for example, fullerene C. 60 Fullerene C 70 and fullerene C 74 Fullerenes and their derivatives are represented by higher-order fullerenes and encapsulated fullerenes. Examples of substituents in fullerene derivatives include halogen atoms, straight-chain, branched, or cyclic alkyl or phenyl groups, groups containing straight-chain or fused aromatic compounds, groups containing halides, partially fluoroalkyl, perfluoroalkyl, silyl, siloxy, arylsilyl, arylthioalkyl, alkylthioalkyl, arylsulfonyl, alkylsulfonyl, arylthio, alkylthio, amino, alkylamino, arylamino, hydroxyl, alkoxy, acylamino, acyloxy, carbonyl, carboxyl, carboxamide, carbonylalkoxy, acyl, sulfonyl, cyano, nitro, chalcogenide-containing groups, phosphin, phosphonate groups, and their derivatives. Specific examples of fullerene derivatives include fluorinated fullerenes, PCBM fullerene compounds, and fullerene polymers. Other examples of n-type semiconductors include organic semiconductors with higher highest occupied molecular orbital (HOMO) and lowest unoccupied molecular orbital (LUMO) energy levels than p-type semiconductors, as well as transparent inorganic metal oxides.

[0112] Examples of n-type organic semiconductors include heterocyclic compounds containing nitrogen, oxygen, or sulfur atoms. Specifically, examples include organic molecules having the following as part of their molecular backbone: pyridine derivatives, pyrazine derivatives, pyrimidine derivatives, triazine derivatives, quinoline derivatives, quinoxaline derivatives, isoquinoline derivatives, acridine derivatives, phenazine derivatives, phenanthroline derivatives, tetrazolium derivatives, pyrazole derivatives, imidazole derivatives, thiazole derivatives, oxazole derivatives, imidazole derivatives, benzimidazole derivatives, benzotriazole derivatives, benzoxazole derivatives, carbazole derivatives, benzofuran derivatives, dibenzofuran derivatives, porphyrinazine derivatives, polyphenylene vinylidene derivatives, polybenzothiadiazole derivatives, polyfluorene derivatives, organometallic complexes, phthalocyanine derivatives, quinacridone derivatives, anthocyanin derivatives, and terpinenine derivatives.

[0113] In addition to p-type and n-type semiconductors, the photoelectric conversion film 22 may also include an organic material that absorbs light within a predetermined wavelength range while transmitting light in other wavelength ranges; this organic material is a so-called pigment material. When the photoelectric conversion film 22 is formed using these three organic materials—p-type semiconductors, n-type semiconductors, and pigment materials—the p-type and n-type semiconductors can be materials that are transparent in the visible light region. With this configuration, in the photoelectric conversion film 22, light within the wavelength range absorbed by the pigment material undergoes selective photoelectric conversion.

[0114] like Figure 3 As shown, the imaging device 1 includes a through electrode 40. The through electrode 40 is a connecting electrode (connection portion) and connects circuits (elements) disposed in different layers. For example, the through electrode 40 is configured to penetrate the semiconductor layer 110. The through electrode 40 is a structure disposed within the semiconductor layer 110 to penetrate the semiconductor layer 110.

[0115] In the imaging device 1, a plurality of through electrodes 40 are provided for each pixel PX. Figure 3 (Through electrodes 40a and 40b in the semiconductor layer). The through electrode 40 is formed, for example, extending from below the photoelectric conversion section 11a or the photoelectric conversion section 11b to the surface 11S2 of the semiconductor layer 110. Figure 3 In the example shown, the through electrode 40 extends in the Z-axis direction and is formed to reach into the wiring layer 120.

[0116] In the imaging apparatus 1, the through electrode 40 electrically connects the photoelectric conversion unit 11a or the photoelectric conversion unit 11b to a circuit disposed on the surface 11S2 side of the semiconductor layer 110. The lower electrode 24a of the photoelectric conversion unit 11a is electrically connected to the readout circuit 15 via the through electrode 40a. The lower electrode 24b of the photoelectric conversion unit 11b is electrically connected to the readout circuit 15 via the through electrode 40b.

[0117] The charge converted by photoelectric conversion unit 11a is transferred from lower electrode 24a to floating diffusion unit FDA of readout circuit 15 via through electrode 40a. The charge converted by photoelectric conversion unit 11b is transferred from lower electrode 24b to floating diffusion unit FDB of readout circuit 15 via through electrode 40b.

[0118] Both the floating diffusion section FDA and the floating diffusion section FDB accumulate the transferred charge. Both the floating diffusion sections FDA and FDB include, for example, semiconductor regions disposed in the semiconductor layer 110.

[0119] The through electrode 40 may contain materials such as tungsten (W), aluminum (Al), copper (Cu), and silver (Ag). The through electrode 40 may also be formed using materials such as cobalt (Co), molybdenum (Mo), and ruthenium (Ru). The through electrode 40 may also contain other metallic materials.

[0120] like Figure 4 As shown, the pixel PX of the imaging device 1 includes the aforementioned photoelectric conversion units 11a and 11b, as well as a readout circuit 15. For example, the readout circuit 15 includes floating diffusion units FDA and FDB, transistor AMP, transistor SEL, transistor RST, and transistor BIN.

[0121] The readout circuit 15 is configured to output a signal based on the charge photoelectrically converted by the photoelectric conversion units 11 (photoelectric conversion units 11a and 11b). The readout circuit 15 is configured to read a signal, for example based on the charge accumulated in the floating diffusion unit FDA, to the signal line L2. This signal is based on the voltage of the floating diffusion unit FDA.

[0122] Each of the transistors AMP, SEL, RST, and BIN is a metal-oxide-semiconductor field-effect transistor (MOSFET) with gate, source, and drain terminals. Figure 4 In the example shown, transistors AMP, SEL, RST, and BIN all include NMOS transistors. Note that the transistors of pixel PX may include PMOS transistors.

[0123] Each of the floating diffuser FDA and the floating diffuser FDB is an accumulation unit and is configured to accumulate the transferred charge. For example, the floating diffuser FD accumulates the charge converted by the photoelectric conversion unit 11a. The floating diffuser FDB accumulates the charge converted by the photoelectric conversion unit 11b.

[0124] The floating diffuser FDA accumulates the transferred charge and converts the transferred charge into a voltage corresponding to the capacitance of the floating diffuser FDA. The floating diffuser FDB accumulates the transferred charge and converts the transferred charge into a voltage corresponding to the capacitance of the floating diffuser FDB. The floating diffusers FDA and FDB can also be referred to as holding parts capable of retaining the transferred charge.

[0125] The transistor AMP is configured to generate and output a signal based on the charge accumulated in the floating diffuser FDA. For example... Figure 4 As shown, the gate of the transistor AMP is electrically connected to the floating diffusion section FDA, and the voltage converted by the floating diffusion section FDA is input to the gate.

[0126] The drain of the transistor AMP is connected to the supplied power supply voltage. Figure 4 The example shown uses a power supply line with a power supply voltage (VDD). The source of transistor AMP is connected to signal line L2 via transistor SEL. Transistor AMP is an amplifying transistor and can generate a signal based on the voltage of the floating diffuser FDA, and output this signal to signal line L2.

[0127] The transistor SEL is configured to control the output of pixel signals. For example, as... Figure 4 As shown, transistor SEL is electrically connected in series with transistor AMP. Transistor SEL is controlled by signal SSEL and is configured to output a signal from transistor AMP to signal line L2. Transistor SEL is a selection transistor and can control the output timing of the pixel signal.

[0128] The transistor SEL is configured to output a signal based on the charge converted by the photoelectric conversion unit 11. The transistor SEL can output the pixel signal of pixel PX to signal line L2. Note that the transistor SEL can be electrically connected between the power supply line supplied with power supply voltage VDD and the transistor AMP. Alternatively, the transistor SEL can be omitted if necessary.

[0129] The transistor RST is configured to reset the voltage of the floating diffuser FDA. Figure 4 In the example shown, transistor RST is electrically connected to the power line supplied with the power supply voltage VDD and is configured to reset the charge. Transistor RST is controlled by signal SRST, which can reset the charge accumulated in the floating diffuser FDA and reset the voltage of the floating diffuser FDA.

[0130] exist Figure 4In the example shown, transistor RST is electrically connected to the power line and the floating diffuser FDA, and can discharge the charge accumulated in the floating diffuser FDA. Note that transistor RST can reset the charge accumulated in the floating diffuser FDB and its voltage via transistor BIN. Transistor RST is a reset transistor.

[0131] The transistor BIN is configured to electrically connect the floating diffuser FDA and the floating diffuser FDB. The transistor BIN is controlled by the signal SBIN, which electrically connects or disconnects the floating diffuser FDA and the floating diffuser FDB. The transistor BIN can also be referred to as a binning element (or a binned transistor).

[0132] For example, in imaging apparatus 1, a transistor BIN is provided for every two photoelectric conversion units 11 (photoelectric conversion units 11a and 11b) that are adjacent to each other in the row direction (or column direction). When the transistor BIN is in the off state, the floating diffusion unit FDA and the floating diffusion unit FDB are electrically disconnected, and the charge converted by the photoelectric conversion unit 11a accumulates in the floating diffusion unit FDA.

[0133] When transistor BIN is in the ON state, floating diffusion section FDA and floating diffusion section FDB are electrically connected. In this case, the charge converted by photoelectric conversion section 11a and the charge converted by photoelectric conversion section 11b accumulate in floating diffusion section FDA and floating diffusion section FDB.

[0134] When transistor BIN is in the ON state, the charge converted by photoelectric conversion units 11a and 11b is accumulated and added in floating diffusion units FDA and FDB. Putting transistor BIN in the ON state allows the charge converted by photoelectric conversion units 11a and 11b to be added, and the pixel signal based on the added charge to be read out.

[0135] Vertical drive circuit 111 of imaging device 1 (see reference) Figure 1 Control signals are supplied to the gates of transistors BIN, SEL, RST, etc. of each pixel PX via the aforementioned control line L1, and the transistors are placed in the on state (conductive state) or the off state (non-conductive state).

[0136] As an example, the multiple control lines L1 of each pixel row of the imaging device 1 include wiring for transmitting the signal SBIN for controlling the transistor BIN, wiring for transmitting the signal SSEL for controlling the crystal SEL, and wiring for transmitting the signal SRST for controlling the transistor RST, etc.

[0137] Transistors BIN, SEL, and RST are controlled to be turned on and off by the vertical drive circuit 111. By controlling the readout circuit 15 of each pixel PX, the vertical drive circuit 111 outputs pixel signals based on the charge generated by the photoelectric conversion unit 11 from each pixel PX to the signal line L2. The vertical drive circuit 111 can perform control to read out the pixel signals of each pixel PX to the signal line L2.

[0138] Figure 5 This is a diagram illustrating an example configuration of an imaging apparatus according to an embodiment. The signal processing circuit 112 of the imaging apparatus 1 includes, for example, an AD conversion circuit 50, a memory 65, and a calculation circuit 80. The AD conversion circuit 50 (AD conversion unit) is configured to perform AD conversion and can output pixel signals converted into digital signals. The AD conversion circuit 50 is an analog-to-digital converter (ADC).

[0139] The AD conversion circuit 50 is configured to convert the input analog signal into a digital signal. The AD conversion circuit 50 performs AD conversion processing on the pixel signal, which is an analog signal input from each pixel PX via signal line L2. For example, the AD conversion circuit 50 is provided for each of the multiple signal lines L2. The AD conversion circuit 50 can be provided for each pixel column of the pixel section 100.

[0140] The AD conversion circuit 50 includes, for example, a comparator circuit 55 and a counter 60. The AD conversion circuit 50 is configured to convert an input pixel signal into a digital signal with a predetermined number of bits. As an example, the AD conversion circuit 50 is a single-slope ADC.

[0141] The comparison circuit 55 includes, for example, a comparator circuit and is configured to compare the pixel signal with a reference signal. The comparison circuit 55 (comparison unit) can compare the pixel signal, which is an analog signal to be converted, with the reference signal to be used for comparison.

[0142] The comparator circuit 55 compares the signal output from pixel PX with a reference signal having a varying voltage (potential) (e.g., a ramp signal having a signal level that changes over time), and outputs a signal as the comparison result. The output signal of the comparator circuit 55 is a signal representing the magnitude relationship between the signal output from pixel PX and the reference signal.

[0143] The counter 60 of the AD conversion circuit 50 is configured to perform counting based on the input signal. The counter 60 (counter circuit) can measure the time until the comparison result in the comparison circuit 55 inverts based on the input clock signal and the output signal from the comparator circuit 55, and output a signal indicating the count value to the memory 65.

[0144] Memory 65 is a storage unit (storage circuit) and includes, for example, a latch (latch circuit). Memory 65 can store (hold) digital signals as pixel signals after AD conversion, which indicate a count value corresponding to the period from the start of comparison by comparison circuit 55 to the inversion (change) of the comparison result. The pixel signals sequentially output from each pixel PX are converted into digital signals by AD conversion in AD conversion circuit 50.

[0145] For example, the AD conversion circuit 50 performs AD conversion on the pixel signal from pixel PX and outputs a pixel signal (pixel signal PA), which is a digital signal based on the charge converted by the photoelectric conversion unit 11a of pixel PX. Furthermore, the AD conversion circuit 50 can output a pixel signal (pixel signal SigAB), which is a digital signal based on the charge converted by the photoelectric conversion unit 11a and the charge converted by the photoelectric conversion unit 11b.

[0146] The calculation circuit 80 is configured to acquire the pixel signal of pixel PX and perform calculation processing. The calculation circuit 80 includes, for example, logic circuits, memory, etc. The calculation circuit 80 is configured to generate a pixel signal (pixel signal PB) based on the charge converted by the photoelectric conversion unit 11b, based on the pixel signal PA and pixel signal SigAB from the AD conversion circuit 50.

[0147] For example, the calculation circuit 80 can generate and output a pixel signal PB corresponding to the charge photoelectrically converted by the photoelectric conversion unit 11b by performing a subtraction operation between the pixel signal SigAB and the pixel signal PA. Note that the calculation circuit 80 may include a processor and a memory. Furthermore, for example, the calculation circuit 80 may be disposed outside the imaging device 1.

[0148] Figure 6 This is a diagram illustrating an operational example of the imaging device according to the implementation scheme. Figure 7 This is a timing diagram illustrating an operational example of the imaging apparatus according to the embodiment. Figure 7 The timing diagram shown illustrates the control signals (SSEL, SRST, and SBIN) to be supplied to the pixel PX of the imaging device 1, with the horizontal axis representing time.

[0149] exist Figure 7 In this process, the transistor receiving a high-level control signal turns on, and the transistor receiving a low-level control signal turns off. Furthermore, Figure 7 The diagram schematically illustrates the pixel signal read from pixel PX and converted by an analog-to-digital converter.

[0150] At time t1, the signal SSEL switches to a high level. The high level switch of the signal SSEL causes... Figure 4The transistor SEL of the pixel PX shown enters the conducting state. In the pixel PX, the charge converted by the photoelectric conversion unit 11a accumulates in the floating diffusion unit FDA.

[0151] During the period from time t1 to time t2, transistor SEL is in the on state. Therefore, transistor AMP outputs a signal corresponding to the voltage of floating diffusion section FDA as signal PDA to signal line L2. This signal is based on the charge signal converted by photoelectric conversion section 11a.

[0152] The signal PDA is a signal corresponding to the charge transmitted from the photoelectric conversion unit 11a when the floating diffusion unit FDA and the floating diffusion unit FDB are electrically disconnected. The signal PDA output to the signal line L2 is converted into a digital signal by AD conversion in the AD conversion circuit 50 of the signal processing circuit 112. The signal processing circuit 112 causes the memory 65 to store (hold) the converted digital signal PDA.

[0153] At time t2, the signal SBIN switches to a high level. The high level of the signal SBIN causes the transistor BIN of pixel PX to enter the conducting state, and the floating diffuser FDB and the floating diffuser FDA are electrically connected to each other.

[0154] The charge converted by photoelectric conversion unit 11a and the charge converted by photoelectric conversion unit 11b are accumulated in floating diffusion units FDA and FDB. In this case, the charge generated by photoelectric conversion units 11a and 11b is added to floating diffusion units FDA and FDB.

[0155] During the period from time t2 to time t3, transistor SEL is in the on state. Therefore, transistor AMP outputs a signal corresponding to the voltage of the floating diffusion section FDA as signal PDAB to signal line L2. This signal is based on the charge converted by photoelectric conversion section 11a and the charge converted by photoelectric conversion section 11b.

[0156] The signal PDAB is a signal corresponding to the charge transmitted from the photoelectric conversion units 11a and 11b when the floating diffusion units FDA and FDB are electrically connected. The signal PDAB output to the signal line L2 is converted into a digital signal by AD conversion in the AD conversion circuit 50.

[0157] At time t3, the signal SRST switches to a high level. The high level of SRST causes the transistor RST of pixel PX to turn on. Therefore, the charge in the floating diffuser FDA and FDB is discharged, and the voltages of the floating diffuser FDA and FDB are reset.

[0158] Furthermore, during the period from time t3 to time t4, transistor SEL is in the on state. Therefore, transistor AMP outputs a signal corresponding to the voltages of the reset floating diffuser FDA and floating diffuser FDB as signal RSAB to signal line L2.

[0159] When the floating diffuser FDA and the floating diffuser FDB are electrically connected, the signal RSAB can also be referred to as a signal indicating the reset level (reference level) of the floating diffuser FDA and the floating diffuser FDB. The signal RSAB is input to the AD conversion circuit 50 via signal line L2.

[0160] For example, the AD conversion circuit 50 sets the signal PDAB as the initial value for the decrementing count and performs AD conversion processing on the signal RSAB. The AD conversion circuit 50 generates a digital signal representing the difference (PDAB - RSAB) between the signal PDAB and the signal RSAB, and outputs this digital signal as the pixel signal SigAB to the calculation circuit 80.

[0161] The signal processing circuit 112 performs the process of reading the signal PDA stored in the memory 65 and writing the signal PDA back to the counter 60 of the AD conversion circuit 50. In the counter 60 of the AD conversion circuit 50, the signal PDA is set to the initial value of the countdown.

[0162] At time t4, the signal SBIN switches to a low level. The switching of the signal SBIN to a low level causes the transistor BIN of pixel PX to enter the cutoff state, and the floating diffuser FDB and floating diffuser FDA are electrically disconnected.

[0163] At time t5, the signal SRST switches to a high level, thus resetting the voltage of the floating diffuser FDA. Furthermore, when transistor SEL is in the ON state, transistor AMP outputs a signal corresponding to the reset voltage of the floating diffuser FDA as signal RSA to signal line L2.

[0164] The signal RSA can also be referred to as the signal indicating the reset level (reference level) of the floating diffuser FDA when the floating diffuser FDA and the floating diffuser FDB are electrically disconnected. The signal RSA is input to the AD conversion circuit 50 via signal line L2.

[0165] The AD conversion circuit 50 uses the signal PDA as the initial value for the decrementing count to perform AD conversion processing on the signal RSA. The AD conversion circuit 50 generates a digital signal representing the difference between the signal PDA and the signal RSA (PDA - RSA), and outputs this digital signal as the pixel signal PA to the calculation circuit 80.

[0166] The calculation circuit 80 uses the pixel signal SigAB and pixel signal PA output from the AD conversion circuit 50 to generate a pixel signal PB. The pixel signal PB is used as a signal component corresponding to the amount of charge converted by the photoelectric conversion unit 11b. In this way, the imaging device 1 can obtain the pixel signal PA corresponding to the charge converted by the photoelectric conversion unit 11a and the pixel signal PB corresponding to the charge converted by the photoelectric conversion unit 11b.

[0167] In pixel PX, the transistor BIN, when in the ON state, increases the capacitance connected to the gate of transistor AMP and changes the conversion gain that converts charge into voltage. When transistor BIN is in the ON state, the capacitance of floating diffuser FDA, floating diffuser FDB, etc., are added to the gate of transistor AMP.

[0168] The calculation circuit 80 is configured to use the capacitance value C of the floating diffuser FDA when the transistor BIN is in the off state. A The capacitance C of the floating diffuser FDA and FDB when the transistor BIN is in the on state. AB The ratio between the two is used to calculate the pixel signal PB.

[0169] The calculation circuit 80 calculates the pixel signal PB based, for example, on the pixel signal SigAB (= PDAB - RSAB), the pixel signal PA, and the following equation (1).

[0170] PB = (PDAB - RSAB) × C AB / C A - PA… (1)

[0171] like Figure 6 As illustrated, the calculation circuit 80 can be generated by multiplying by the coefficient C. AB / C A The pixel signal PB is calculated by subtracting the pixel signal PA (PDA - RSA) from the pixel signal SigAB value (= PDAB - RSAB). This calculation can be performed while taking into account differences in conversion gain, allowing for high-precision calculation of the pixel signal PB.

[0172] The signal processing circuit 112, for example, uses the calculation circuit 80 to calculate the pixel signal PA and pixel signal PB of each pixel PX. The signal processing circuit 112 outputs the pixel signals PA and PB to the output circuit 114 via the horizontal signal line 121. The output circuit 114 can output the pixel signal of each pixel PX to the outside of the imaging device 1.

[0173] Figure 8 This is a timing diagram illustrating an operational example of the imaging apparatus according to the embodiment. See below for reference. Figure 8 The timing diagram further illustrates the operation example of imaging device 1. Figure 8 The example shown is an example of calculating a pixel signal (pixel signal PAB) corresponding to the charge obtained by adding the charge converted by photoelectric conversion unit 11a and the charge converted by photoelectric conversion unit 11b.

[0174] When signal SBIN is high, transistor BIN is in the on state. In this case, the charge converted by photoelectric conversion unit 11a and the charge converted by photoelectric conversion unit 11b accumulate in floating diffusion units FDA and FDB. The respective charges converted by photoelectric conversion units 11a and 11b are added to floating diffusion units FDA and FDB.

[0175] At time t11, the signal SSEL switches to a high level, thus the transistor SEL of pixel PX enters the conducting state. During the period from time t11 to time t12, the transistor AMP outputs a signal as signal PDAB to signal line L2, corresponding to the voltage of the floating diffusion section FDA. This signal is based on the charge converted by photoelectric conversion section 11a and the charge converted by photoelectric conversion section 11b. The signal PDAB output to signal line L2 is converted into a digital signal by the AD conversion circuit 50.

[0176] At time t12, the signal SRST switches to a high level. The high level of SRST causes the transistor RST of pixel PX to turn on. Therefore, the charge in the floating diffuser FDA and FDB is discharged, and the voltages of the floating diffuser FDA and FDB are reset.

[0177] During the period from time t12 to time t13, transistor SEL is in the on state, so transistor AMP outputs a signal corresponding to the voltages of the reset floating diffuser FDA and floating diffuser FDB as signal RSAB to signal line L2. Signal RSAB is input to AD conversion circuit 50 via signal line L2.

[0178] For example, the AD conversion circuit 50 sets the signal PDAB as the initial value for the decrementing count and performs AD conversion processing on the signal RSAB. The AD conversion circuit 50 generates a digital signal representing the difference (PDAB - RSAB) between the signal PDAB and the signal RSAB, and outputs this digital signal as the pixel signal SigAB to the calculation circuit 80.

[0179] The calculation circuit 80 calculates the pixel signal PAB based, for example, on the pixel signal SigAB (= PDAB - RSAB) and the following equation (2).

[0180] PAB = (PDAB - RSAB) × C AB / C A … (2)

[0181] For example, the calculation circuit 80 multiplies the pixel signal SigAB (= PDAB - RSAB) by a coefficient C. AB / C A The pixel signal PAB is calculated. The imaging device 1 can obtain a pixel signal PAB corresponding to the charge obtained by adding the charge converted by the photoelectric conversion unit 11a and the charge converted by the photoelectric conversion unit 11b.

[0182] In the imaging apparatus 1 according to this embodiment, as described above, a transistor BIN is provided that can electrically connect the floating diffusion section FDA and the floating diffusion section FDB. Compared to the case where two MOS transistors are provided for each pixel as switching elements, the number of components and wiring can be reduced. The imaging apparatus 1 can have a structure that is conducive to pixel miniaturization.

[0183] Furthermore, in this embodiment, compared to the case of using multiple switching elements, it is more effective to prevent the addition of large parasitic capacitances to the floating diffusion, thus reducing the degradation of the conversion gain. It also prevents the reduction of the signal-to-noise ratio (S / N ratio), thereby obtaining low-noise pixel signals.

[0184] Figure 9 This is another example of the cross-sectional configuration of the imaging apparatus according to the embodiment. Furthermore, Figure 10 This is a diagram illustrating another example of the circuit configuration of the pixels of an imaging apparatus according to an embodiment. Each pixel PX of the imaging apparatus 1 may include a photoelectric conversion unit 11s, as... Figure 9 and Figure 10 As shown in the example.

[0185] In the semiconductor layer 110, a plurality of photoelectric conversion units 11s are provided along surfaces 11S1 and 11S2 of the semiconductor layer 110. For example, the photoelectric conversion unit 11s of each pixel PX is formed and embedded in the semiconductor layer 110. The photoelectric conversion unit 11s is a photodiode (PD) and converts incident light into electric charge.

[0186] exist Figure 9 In the example shown, light from the subject being measured is incident via lens 91 onto photoelectric conversion units 11a, 11b, and 11s of pixel PX. For example, light passing through photoelectric conversion unit 11a or photoelectric conversion unit 11b is incident onto photoelectric conversion unit 11s of pixel PX. Figure 9In the example shown, the photoelectric conversion unit 11s can perform photoelectric conversion on the light passing through the lens 91 and the photoelectric conversion unit 11a (or photoelectric conversion unit 11b) to generate an electric charge.

[0187] The readout circuit 15 of pixel PX is configured to output a signal based on the charge photoelectrically converted by the photoelectric conversion unit 11s. For example... Figure 10 As shown, the readout circuit 15 includes a transistor TG. The transistor TG is a transfer transistor and is configured to transfer the charge photoelectrically converted by the photoelectric conversion unit 11s.

[0188] Transistor TG is controlled by signal STG and electrically connects or disconnects the photoelectric conversion unit 11s and the floating diffusion unit FDA. Transistor TG can transfer the photoelectric conversion and accumulated charge in the photoelectric conversion unit 11s to the floating diffusion unit FDA.

[0189] Imaging device 1 can acquire pixel signals based on the charge converted by photoelectric conversion unit 11a, pixel signals based on the charge converted by photoelectric conversion unit 11b, and pixel signals based on the charge converted by photoelectric conversion unit 11s. Note that each of photoelectric conversion units 11a, 11b, and 11s can be configured to receive visible light and perform photoelectric conversion thereon, or can be configured to receive infrared light (e.g., near-infrared light) and perform photoelectric conversion thereon.

[0190] Photoelectric conversion units 11a, 11b, and 11s can be configured to perform photoelectric conversion on visible light within different wavelength ranges to generate charge. As an example, photoelectric conversion units 11a and 11b can be configured to perform photoelectric conversion on visible light within different wavelength ranges to generate charge. Photoelectric conversion unit 11s can be configured to perform photoelectric conversion on infrared light to generate charge.

[0191] Using the pixel signals of each pixel PX makes it possible to generate visible light images (e.g., RGB images), infrared images (IR images), etc. Note that the respective wavelength ranges representing the sensitivity in photoelectric conversion units 11a, 11b, and 11s can be set in any suitable manner.

[0192] [Functions and Effects]

[0193] The light detection device according to this embodiment includes: a first photoelectric conversion element (photoelectric conversion section 11a) and a second photoelectric conversion element (photoelectric conversion section 11b), each photoelectric conversion element having a photoelectric conversion film (photoelectric conversion film 22) for performing photoelectric conversion of light; and a readout circuit (readout circuit 15), which includes a first floating diffusion section (floating diffusion section FDA) electrically connected to the first photoelectric conversion element and a second floating diffusion section (floating diffusion section FDB) electrically connected to the second photoelectric conversion element, and is capable of outputting a signal based on the charge accumulated in the first floating diffusion section. The readout circuit includes a first transistor (transistor BIN) capable of electrically connecting the first floating diffusion section and the second floating diffusion section.

[0194] In the light detection apparatus (imaging apparatus 1) according to this embodiment, a transistor BIN capable of electrically connecting the floating diffuser FDA and the floating diffuser FDB is provided. Therefore, the imaging apparatus 1 can have a structure that is conducive to pixel miniaturization. A light detection apparatus that is conducive to miniaturization can be obtained.

[0195] Next, variations of this disclosure will be described. In the following description, components similar to the embodiments described above will be given the same reference numerals, and descriptions will be omitted as appropriate.

[0196] <2. Variations>

[0197] (2-1. Variation Example 1)

[0198] Although the above embodiments illustrate an example of the configuration of the imaging device 1, the imaging device 1 is not limited to the above examples. Figure 11 and Figure 12 This is a diagram illustrating a configuration example of the imaging apparatus according to Modification 1 of the present disclosure. For example, the transistor BIN may be disposed on the surface 11S1 side of the semiconductor layer 110, or it may be disposed on the surface 11S2 side.

[0199] As an example, the transistor BIN can be set as a thin-film transistor (TFT). As... Figure 11 As shown in the example, the transistor BIN can be formed as a thin-film transistor (TFT) in the wiring layer 130. Figure 11 As shown, arranging the transistor BIN on the surface 11S1 side of the semiconductor layer 110 can reduce the number of through electrodes 40.

[0200] Optionally, as Figure 12 As shown in the example, the transistor bin can be disposed in the wiring layer 120. This reduces the number of components on facet 11S2 of the semiconductor layer 110, enabling further miniaturization. As... Figure 11 or Figure 12As shown in the example, the transistor BIN includes a gate electrode 14, an insulating film 16 serving as a gate insulating film, and a semiconductor region 17 serving as a region forming a channel (channel region). Furthermore, for example, the transistor BIN includes a source and a drain.

[0201] Figure 13 This is a diagram illustrating an example of the planar configuration of the imaging device according to Modification 1. As... Figure 13 As shown in the example, the through electrode 40 can be positioned in pixel PX away from the optical center of lens 91. This configuration prevents a decrease in sensitivity to incident light. Furthermore, the through electrode 40 can be positioned at approximately equal distances from the optical centers of each lens 91 in the surrounding plurality of pixels PX. In this case, optical symmetry can be achieved.

[0202] The semiconductor region 17 (channel region) of the transistor BIN can be formed on an axis passing through the optical center of the lens 91. Furthermore, the semiconductor region 17 can be located at approximately equal distances from the lower electrode 24a and the lower electrode 24b. Additionally, the semiconductor region 17 can be located at the center of the pixel PX. Because the imaging device 1 is configured in this way, the sensitivity variation between the photoelectric conversion units 11a and 11b can be reduced.

[0203] (2-2. Variation Example 2)

[0204] Figure 14 This is a diagram illustrating an example of the pixel configuration of the imaging device according to Modified Example 2. For example... Figure 14 As shown, pixel PX may include capacitor C1. Capacitor C1 is provided for the floating diffuser FDB, for example, as a coefficient (C) used to adjust the aforementioned coefficient. AB / C A ) capacitor.

[0205] Capacitor C1 includes, for example, wiring capacitors, diffusion capacitors, etc. Capacitor C1 can be a metal-insulator-metal (MIM) capacitor, a metal-oxide-semiconductor (MOS) capacitor, etc., and can be formed as a capacitive element. In imaging apparatus 1, for example, capacitor C1 is configured such that the coefficient C... AB / C A = 2. This configuration simplifies the computational processing of the pixel signals described above.

[0206] (2-3. Variation Example 3)

[0207] Figure 15 This is a diagram illustrating an example of the pixel configuration of the imaging apparatus according to Modified Example 3. Pixel PX may include a transistor OFGB. The transistor OFGB is electrically connected, for example, to the floating diffuser FDB and is configured to discharge overflow charge.

[0208] One of the source and drain of the transistor OFGB, or for example, the source of the transistor OFGB, is electrically connected to the floating diffuser FDB. Furthermore, the other of the source and drain of the transistor OFGB, or for example, the drain of the transistor OFGB, is electrically connected, as an example, to a potential line or capacitor element supplied with a predetermined potential (voltage).

[0209] By controlling the gate of the transistor OFGB, the vertical drive circuit 111 can set a potential in the overflow path formed by the transistor OFGB. For example, the vertical drive circuit 111 can control the voltage supplied to the gate of the transistor OFGB and discharge overflow charge. Furthermore, setting the gate of the transistor OFGB to a high level can give the transistor OFGB the function equivalent to the transistor RST, which means that the floating diffuser FDB can be reset.

[0210] Note that, as Figure 16 As shown, pixel PX may include a transistor OFGA. The transistor OFGA is electrically connected to the floating diffuser FDA and is configured to discharge overflow charge. Vertical drive circuit 111 can control the voltage supplied to the gate of transistor OFGA and cause overflow charge to be discharged.

[0211] (2-4. Variation Example 4)

[0212] Figure 17 This is a diagram illustrating an example of the pixel configuration of the imaging apparatus according to Modification 4. The readout circuit 15 may include a transistor FDG. For example, the transistor FDG is configured to electrically connect the floating diffuser FDA and the transistor RST. For example, the transistor FDG is controlled by the signal SFDG, and the floating diffuser FDA and the transistor RST are electrically connected or disconnected.

[0213] The transistor FDG, once in the ON state, increases the capacitance of the floating diffuser FDA to be added to pixel PX and switches the conversion gain used to convert charge into voltage. The FDG is a switching transistor used to set the conversion gain. The FDG can switch the capacitance connected to the gate of transistor AMP and thus change the conversion gain.

[0214] Transistor FDG can be electrically connected in series with transistor RST, or it can be electrically connected in parallel with transistor RST. As... Figure 17 As shown in the example, pixel PX may include capacitor C2 connected to transistor FDG. Capacitor C2 may include, for example, wiring capacitor, diffusion capacitor, etc. Capacitor C2 may be a MIM capacitor, MOS capacitor, etc., and may be constructed as a capacitive element.

[0215] like Figure 18As shown, transistor FDG can be configured to electrically connect the floating diffuser FDA and capacitor C2. For example, transistor FDG is controlled by signal SFDG, and the floating diffuser FDA and capacitor C2 are electrically connected or disconnected. Switching the connection state of capacitor C2 allows the conversion gain to be changed.

[0216] (2-5. Variation Example 5)

[0217] Figure 19 This diagram illustrates an example of the pixel configuration of the imaging apparatus according to Modified Example 5. Pixel PX may include photoelectric conversion units 11c and 11d in semiconductor layer 110. Photoelectric conversion units 11d and 11c are disposed adjacent to each other. The readout circuit 15 of pixel PX may include transistor TGA and transistor TGB.

[0218] The transistor TGA is configured to transfer the charge photoelectrically converted by the photoelectric conversion unit 11c to the floating diffusion unit FDA. The transistor TGB is configured to transfer the charge photoelectrically converted by the photoelectric conversion unit 11d to the floating diffusion unit FDA. Each of the transistors TGA and TGB is a transfer transistor.

[0219] Photoelectric conversion unit 11c is disposed, for example, in semiconductor layer 110, located below photoelectric conversion unit 11a. Furthermore, photoelectric conversion unit 11d is disposed in semiconductor layer 110, located below photoelectric conversion unit 11b. Figure 19 As schematically shown by the arrow, the photoelectric conversion unit 11c receives light transmitted through the photoelectric conversion unit 11a and generates charge through photoelectric conversion.

[0220] Furthermore, photoelectric conversion unit 11d receives light transmitted through photoelectric conversion unit 11b and generates charge through photoelectric conversion. In each pixel PX of the imaging device 1, photoelectric conversion units 11c and 11d receive light transmitted through different regions of an optical system such as an imaging lens and perform pupil segmentation. Note that the arrangement direction of photoelectric conversion units 11a and 11b may be different from that of photoelectric conversion units 11c and 11d.

[0221] For example, such as Figure 20 As shown, photoelectric conversion unit 11a and photoelectric conversion unit 11b can be arranged adjacent to each other in the horizontal direction (X-axis direction). Alternatively, for example, as... Figure 21 As shown, photoelectric conversion unit 11a and photoelectric conversion unit 11b can be arranged adjacent to each other in the vertical direction (Y-axis direction).

[0222] Pixel PX may include two or more photoelectric conversion units 11, or for example, may include four photoelectric conversion units 11 (in Figure 22 and Figure 23The example shown is of photoelectric conversion units 11a to 11d. Furthermore, as... Figure 23 As shown, a pixel PX may include multiple transistors BIN, and optionally, for example, may include transistors BINB, BINC, and BIND.

[0223] The transistor BINC is configured to electrically connect the floating diffuser FDA and the floating diffuser FDC. The transistor BINC is controlled by the signal SBINC, which electrically connects or disconnects the floating diffuser FDA and the floating diffuser FDC.

[0224] The transistor BINB is configured to electrically connect the floating diffuser FDA and the floating diffuser FDB. The transistor BINB is controlled by the signal SBINB, which electrically connects or disconnects the floating diffuser FDA and the floating diffuser FDB.

[0225] Furthermore, the transistor BIND is configured to electrically connect the floating diffuser FDA and the floating diffuser FDD. The transistor BIND is controlled by the signal SBIND, which electrically connects or disconnects the floating diffuser FDA and the floating diffuser FDD.

[0226] In the imaging device 1, for example, a lens 91 is provided for the photoelectric conversion units 11a to 11d. In the imaging device 1, the photoelectric conversion units 11a to 11d receive light passing through different areas of an optical system such as an imaging lens, thereby enabling pupil segmentation.

[0227] Note that, as Figure 24 As shown, in addition to the three transistors BIN (transistors BINB, BINC, and BIND), a dummy transistor can also be set in pixel PX. Figure 24 In the example shown, symmetry can be achieved by setting a dummy transistor for each pixel PX.

[0228] (2-6. Variation Example 6)

[0229] Figures 25 to 27 This is a diagram illustrating an example of the configuration of the imaging apparatus according to Modification 6. The pixel PX of the imaging apparatus 1 may include, for example, photoelectric conversion unit 11s1 and photoelectric conversion unit 11s2, such as... Figure 25 As shown. The photoelectric conversion unit 11s2 is formed in the semiconductor layer 110 and is stacked on the photoelectric conversion unit 11s1.

[0230] exist Figure 25In the example shown, photoelectric conversion unit 11s2 is closer to the light incident side than photoelectric conversion unit 11s1. Each of photoelectric conversion units 11s1 and 11s2 performs photoelectric conversion to generate a charge corresponding to the amount of light received. Each of the photoelectric conversion units 11s1 and 11s2 of each pixel PX can also be referred to as a photoelectric conversion region.

[0231] Photoelectric conversion units 11s1 and 11s2 can be configured to perform photoelectric conversion on light within different wavelength ranges from each other. For example, depending on the position of photoelectric conversion units 11s1 and 11s2 in the semiconductor layer 110, their constituent materials, etc., photoelectric conversion units 11s1 and 11s2 can selectively receive light within a specific wavelength range and perform photoelectric conversion on it.

[0232] Photoelectric conversion units 11s1 and 11s2 are located at different distances (depths) from the surface 11s1 of the semiconductor layer 110, and absorb light of different color wavelengths according to the incident depth (penetration depth) to generate charge. Figure 25 In the example shown, the photoelectric conversion unit 11s1 is disposed below the photoelectric conversion unit 11s2, and can perform photoelectric conversion on the light passing through the photoelectric conversion unit 11s2 to generate charge.

[0233] For example, the photoelectric conversion units 11a and 11b of pixel PX mainly receive and photoelectrically convert light in the green (G) wavelength range from the light emitted from the subject being measured. Photoelectric conversion unit 11s2 mainly receives and photoelectrically converts light in the blue (B) wavelength range. On the other hand, photoelectric conversion unit 11s1 mainly receives and photoelectrically converts light in the red (R) wavelength range. Each pixel PX of imaging device 1 can generate pixel signals with R, G, and B components. Imaging device 1 can acquire RGB pixel signals.

[0234] In addition, for example, such as Figure 26 As shown, the imaging device 1 may include a light-receiving layer 30 having a photoelectric conversion unit 11c. The light-receiving layer 30 including the photoelectric conversion unit 11c is configured to be stacked on top of the light-receiving layer 20 including photoelectric conversion units 11a and 11b. As... Figure 26 As shown in the example, each pixel PX's photoelectric conversion unit 11c includes a photoelectric conversion film 32, an upper electrode 33, and a lower electrode 34, and is configured to generate charge through photoelectric conversion. The photoelectric conversion unit 11c can be configured to perform photoelectric conversion on light with a wavelength range different from that of the photoelectric conversion units 11a and 11b.

[0235] As an example, the photoelectric conversion unit 11c of pixel PX mainly receives and photoelectrically converts light in the blue (B) wavelength range from the light emitted from the subject being measured. Photoelectric conversion units 11a and 11b mainly receive and photoelectrically convert light in the green (G) wavelength range. On the other hand, the photoelectric conversion unit 11s mainly receives and photoelectrically converts light in the red (R) wavelength range.

[0236] as Figure 27 As shown in the example, the imaging device 1 may include a filter 92. The filter 92 is configured to selectively transmit light within a specific wavelength range of the incident light. The filter 92 is, for example, an RGB color filter, an infrared light transmission filter (IR passband filter), etc.

[0237] Filter 92 is positioned above the photoelectric conversion unit 11s, for example, for each pixel PX or each group of pixels PX. Figure 27 In the example shown, filter 92 is disposed in wiring layer 130 and located above photoelectric conversion unit 11s. Photoelectric conversion unit 11s receives and photoelectrically converts light, for example, that passes through lens 91, photoelectric conversion unit 11a (or photoelectric conversion unit 11b) and filter 92.

[0238] As an example, when photoelectric conversion units 11a and 11b receive and photoelectrically convert light in the green (G) wavelength range, pixels PX including a filter 92 that transmits red (R) light and pixels PX including a filter 92 that transmits blue (B) light can be provided. Note that the configuration of filter 92 is not limited to the above example and can be set appropriately.

[0239] (2-7. Variation Example 7)

[0240] Figure 28 This is a timing diagram showing an operation example of the imaging apparatus according to Modification 7. Refer below for... Figure 28 , Figure 4 , Figure 5 Examples of operation of imaging device 1 are explained below. Figure 28 An example is shown of alternating operations in each pixel PX: resetting the floating diffuser (shutter operation) and reading out the signal corresponding to the charge converted by photoelectric conversion (readout operation).

[0241] After resetting the floating diffuser via shutter operation, the pixel signal corresponding to photoelectric conversion and accumulated charge is read out via readout operation. For example, in Figure 28 In the example shown, the period Ta from time t3 to time t7 is the period during which charge corresponding to the incident light is generated and accumulated, and is also the signal accumulation period (i.e., the charge accumulation period).

[0242] At time t1, signal SSEL switches to high level, and signal SRST switches to high level. As a result, transistor AMP outputs a signal as signal RDA to signal line L2, corresponding to the voltage of the floating diffuser FDA when transistor RST (reset transistor) is in the on state.

[0243] At time t2, the signal SBIN switches to a high level. Furthermore, since transistor SEL is in the on state, a signal corresponding to the voltages of the floating diffusers FDA and FDB when transistor RST is on is output as signal RDAB to signal line L2.

[0244] At time t3, signal SRST switches low. Therefore, transistor AMP outputs a signal corresponding to the voltages of the reset floating diffuser FDA and FDB as signal RSAB to signal line L2. Furthermore, at time t4, signal SBIN switches low. Therefore, a signal corresponding to the voltage of the reset floating diffuser FDA is output as signal RSA to signal line L2.

[0245] Signal processing circuit 112 performs signal processing such as AD conversion and correlated double sampling on signals RDA, RDAB, RSAB, and RSA. For example, signal processing circuit 112 performs CDS processing to subtract signal RDA from signal RSA and stores the CDS result (RSA - RDA) in memory 65. Furthermore, signal processing circuit 112 performs CDS processing to subtract signal RDAB from signal RSAB and stores the CDS result (RSAB - RDAB) in memory 65.

[0246] At time t5, signal SSEL switches to a high level. On the other hand, signal SBIN is at a low level, and transistor BIN is in the off state. In this case, transistor AMP outputs a signal based on the charge converted by photoelectric conversion unit 11a as signal PDA to signal line L2.

[0247] At time t6, the signal SBIN switches to a high level. Furthermore, since transistor SEL is in the on state, transistor AMP outputs a signal based on the charge converted by photoelectric conversion units 11a and 11b as signal PDAB to signal line L2.

[0248] At time t7, signal SRST switches to a high level. Therefore, a signal corresponding to the voltages of the floating diffuser FDA and FDB when transistor RST is in the on state is output to signal line L2 as signal RDAB. Furthermore, at time t8, signal SBIN switches to a low level. Therefore, a signal corresponding to the voltage of the floating diffuser FDA when transistor RST is in the on state is output to signal line L2 as signal RDA.

[0249] Signal processing circuit 112 performs signal processing such as AD conversion and correlated double sampling on signals PDA, PDAB, RDAB, and RDA. For example, signal processing circuit 112 performs CDS processing to subtract signal RDA from signal PDA and stores the CDS result (PDA - RDA) in memory 65. Furthermore, signal processing circuit 112 performs CDS processing to subtract signal RDAB from signal PDAB and stores the CDS result (PDAB - RDAB) in memory 65.

[0250] The signal processing circuit 112 calculates the pixel signal PA and the pixel signal PAB based on the CDS results stored in the memory 65 and the following equations (3) and (4).

[0251] PA = (PDA - RDA) - (RSA - RDA) = PDA - RSA… (3)

[0252] PAB = (PDAB - RDAB) - (RSAB - RDAB) = PDAB - RSAB… (4)

[0253] In addition, the signal processing circuit 112 calculates the pixel signal PB based on the pixel signal PAB and the following formula (5).

[0254] PB = (PDAB - RSAB) × C AB / C A - PA… (5)

[0255] By performing signal readout and calculation as described above, the difference between the signal component and the reset component is obtained, and kTC noise can be eliminated.

[0256] (2-8. Variation Example 8)

[0257] Figure 29 and Figure 30 This is a diagram illustrating an example of the configuration of the imaging device according to Modification 8. For example... Figure 29As shown, the imaging device 1 may include an amplifier circuit 19. The amplifier circuit 19 is configured to output, for example, a voltage based on a signal output from the readout circuit 15 and a reference voltage.

[0258] exist Figure 29 In the example shown, a signal based on the voltage of the floating diffuser FDA is input from the readout circuit 15 to one input of the amplifier circuit 19. A reference voltage Vref is input from an external circuit to the other input of the amplifier circuit 19. The amplifier circuit 19 can generate and output a voltage Vout, which serves as the signal voltage corresponding to the voltage of the output signal of the readout circuit 15 and the reference voltage Vref.

[0259] The transistor RST of pixel PX is configured to reset the floating diffuser FDA based on the voltage Vout output from amplifier circuit 19. In this variation, the reset operation can be performed by feeding back the voltage Vout corresponding to the output voltage of readout circuit 15, thereby reducing kTC noise.

[0260] Note that, as Figure 30 As in the example in the timing diagram, the periods Tb1 and Tb2 during which the signal SRST is high can be set to relatively long periods, while taking into account the settling time of the aforementioned feedback. Therefore, kTC noise can be effectively reduced.

[0261] (2-9. Variation Example 9)

[0262] Figure 31 This is a diagram illustrating an example of the configuration of the imaging apparatus according to Modification 9. The pixel PX may include multiple output control circuits 18 ( Figure 31 The output control circuits 18a and 18b are included. Each of the output control circuits 18a and 18b includes, for example, capacitors C3 and C4, transistors RES, SIG, RSTB, AMPB, and SELB.

[0263] like Figure 31 As shown, output control circuit 18a and output control circuit 18b are controlled by different signals. Furthermore, for example, output control circuit 18a is configured to output a pixel signal to signal processing circuit 112 via signal line L2a. Output control circuit 18b is configured to output a pixel signal to signal processing circuit 112 via signal line L2b.

[0264] Figure 32This is a timing diagram showing an operation example of the imaging apparatus according to Modification 9. At time t1, signal SRST switches to a high level. Furthermore, signal SRSTB2 becomes high, and signal SRES2 becomes high. Therefore, transistor RSTB of output control circuit 18b enters the conducting state, and transistor RES also enters the conducting state. Signal SBIN is at a high level, and transistor BIN is in the conducting state.

[0265] At time t2, signal SRES2 transitions from high to low. As a result, the reset component, corresponding to the voltages of the floating diffusers FDA and FDB when transistor RST is in the on state, is held as signal RSAB in capacitor C3 of output control circuit 18b. In output control circuit 18b, the value of signal RSAB is determined at the moment signal SRES2 switches from high to low, and signal RSAB is held in capacitor C3.

[0266] At time t3, signals SRSTB1 and SRES1 switch to high level. Therefore, transistor RSTB and transistor RES of output control circuit 18a are turned on. Signal SBIN is low, and transistor BIN is off.

[0267] At time t4, signal SRES1 transitions from high to low. As a result, the reset component, corresponding to the voltage of the floating diffuser FDA when transistor RST is in the on state, is held as signal RSA in capacitor C3 of output control circuit 18a. In output control circuit 18a, the value of signal RSA is determined at the moment signal SRES1 switches from high to low, and signal RSA is held in capacitor C3.

[0268] After photoelectric conversion is performed during the signal accumulation period (charge accumulation period), at time t5, signals SRSTB1 and SSIG1 switch to high level. As a result, transistor RSTB of the output control circuit 18a turns on, and transistor SIG turns on as well. Note that signal SBIN is low, and transistor BIN is off.

[0269] At time t6, signal SSIG1 transitions from high to low. As a result, a signal based on the charge converted by photoelectric conversion unit 11a is held as signal PDA in capacitor element C4 of output control circuit 18a. In output control circuit 18a, the value of signal PDA is determined at the moment signal SSIG1 transitions from high to low, and signal PDA is held in capacitor element C4.

[0270] At time t7, signals SRSTB2 and SSIG2 switch to high level. As a result, transistor RSTB in the output control circuit 18b turns on, and transistor SIG also turns on. On the other hand, signal SBIN is high, and transistor BIN turns on.

[0271] At time t8, signal SSIG2 transitions from high to low. As a result, a signal based on the charge converted by photoelectric conversion unit 11a and the charge converted by photoelectric conversion unit 11b is held as signal PDAB in capacitor element C4 of output control circuit 18b. In output control circuit 18b, the value of signal PDAB is determined at the moment signal SSIG2 transitions from high to low, and signal PDAB is held in capacitor element C4.

[0272] At time t9, signal RSTB1 switches to high level to reset. Figure 31 The voltage at node N1 of the output control circuit 18a shown is reset. Additionally, signal RSTB2 is switched high to reset the voltage at node N1 of the output control circuit 18b.

[0273] During the period from time t10 to time t11, signal SRES1 is at a high level. Additionally, signal SSELB1 is at a high level. Therefore, the signal based on the voltage held in capacitor C3 of output control circuit 18a, i.e., signal RSA, is read out by transistor AMPB of output control circuit 18a onto signal line L2a.

[0274] Furthermore, during the period from time t10 to time t11, signal SRES2 is at a high level. Therefore, the signal based on the voltage held in capacitor C3 of output control circuit 18b, i.e., signal RSAB, is read out by transistor AMPB of output control circuit 18b to signal line L2b. Note that at time t12, both signals RSTB1 and RSTB2 switch to a high level, and node N1 is reset.

[0275] During the period from time t13 to time t14, signal SSIG1 is at a high level. Therefore, the signal based on the voltage held in capacitor C4 of output control circuit 18a, i.e., signal PDA, is read out by transistor AMPB of output control circuit 18a onto signal line L2a.

[0276] Furthermore, during the period from time t13 to time t14, signal SSIG2 is at a high level. Therefore, the signal based on the voltage held in capacitor element C4 of output control circuit 18b, i.e., signal PDAB, is read out by transistor AMPB of output control circuit 18b to signal line L2b.

[0277] The signal processing circuit 112 performs signal processing such as AD conversion and subtraction on the signals RSA, RSAB, PDA, and PDAB. For example, the signal processing circuit 112 can perform CDS processing to subtract the signal RSA from the signal PDA and obtain the pixel signal PA indicating (PDA - RSA).

[0278] In addition, the signal processing circuit 112 can obtain the pixel signal PB based on the pixel signal PA and the following formula (6).

[0279] PB = (PDAB - RSAB) × C AB / C A - PA… (6)

[0280] As described above, the subtraction process between the reset component and the signal component enables the acquisition of a pixel signal with reduced kTC noise.

[0281] (2-10. Variation Example 10)

[0282] Figure 33A and 33B This is a diagram illustrating an example of the configuration of the imaging apparatus according to Modification 10. The above-described calculation circuit 80 can be as follows: Figure 33A As shown, it can be installed in the imaging device 1, or as... Figure 33B It is arranged outside the imaging device 1 as shown. For example, a light detection system 300 including a calculation device (calculation circuit 80) and a light detection device (imaging device 1) can be constructed.

[0283] <3. Applicable Examples>

[0284] (Applicable Example 1)

[0285] The light detection device (imaging device 1) described above can be used in various electronic devices, such as imaging systems including digital still cameras or digital video cameras, mobile phones with imaging capabilities, or other devices with imaging capabilities.

[0286] Figure 34 This is a block diagram illustrating an example of the configuration of an electronic device.

[0287] like Figure 34 As shown, the electronic device 1001 includes an optical system 1002, a light detection device 1003, and a digital signal processor (DSP) 1004. It has a configuration in which the DSP 1004, a display device 1005, an operating system 1006, a memory 1008, a recording device 1009, and a power supply system 1010 are connected via a bus 1007, and is capable of capturing still images and moving images.

[0288] The optical system 1002 includes one or more lenses that guide image light (incident light) from the subject onto the light detection device 1003 and form an image on the light receiving surface (sensor section) of the light detection device 1003.

[0289] The aforementioned light detection device (imaging device 1) can be used as light detection device 1003. In light detection device 1003, electrons are accumulated within a predetermined time period based on the image formed on the light receiving surface via optical system 1002. Subsequently, a signal corresponding to the electrons accumulated in light detection device 1003 is transmitted to DSP 1004.

[0290] The DSP 1004 performs various signal processing operations on the signals from the photodetector 1003 to acquire images, and temporarily stores the image data in the memory 1008. The image data stored in the memory 1008 is either recorded in the recording device 1009 or supplied to the display device 1005 for image display. Furthermore, the operating system 1006 receives various user operations and supplies operation signals to the various blocks in the electronic device 1001. The power supply system 1010 supplies the power required to drive the various blocks in the electronic device 1001.

[0291] (Applicable Example 2)

[0292] Figure 35A An example of the overall configuration of a light detection system 2000, including a light detection device (imaging device 1), is shown schematically. Figure 35B An example of the circuit configuration of the light detection system 2000 is shown schematically. The light detection system 2000 includes a light-emitting device 2001 that serves as a light source unit for emitting light Lb and a light detection device 2002 that serves as a light receiving unit having a photoelectric conversion element.

[0293] The aforementioned light detection device (imaging device 1) can be used as light detection device 2002. The light detection system 2000 may also include a system control unit 2003, a light source driving unit 2004, a sensor control unit 2005, a light source-side optical system 2006, and a camera-side optical system 2007.

[0294] The light detection device 2002 can detect light La and light Lb. Light La is obtained by reflecting ambient light from the subject (object to be measured) 2100 (see reference). Figure 35A Light Lb is light emitted by the light-emitting device 2001 and reflected by the subject 2100. Light La is, for example, visible light, and light Lb is, for example, infrared light.

[0295] Light La can be detected by the photoelectric conversion unit in the light detection device 2002, and light Lb can be detected by the photoelectric conversion unit in the light detection device 2002. Image information about the subject 2100 can be obtained from light La, and distance information indicating the distance between the subject 2100 and the light detection system 2000 can be obtained from light Lb.

[0296] The light detection system 2000 can be installed in electronic devices such as smartphones or in mobile bodies such as vehicles. The light emission device 2001 can be formed using, for example, a semiconductor laser, a surface-emitting semiconductor laser, or a vertical-cavity surface-emitting laser (VCSEL).

[0297] As a method for the light detection device 2002 to detect the light Lb emitted from the light-emitting device 2001, for example, an iTOF method can be used, but the detection method is not limited to the iTOF method. Using the iTOF method, the photoelectric conversion unit can use, for example, time-of-flight (TOF) to measure the distance to the subject 2100.

[0298] As a method for the light detection device 2002 to detect the light Lb emitted from the light emission device 2001, a structured light method or a stereoscopic vision method may also be used, for example. For example, with the structured light method, the distance between the light detection system 2000 and the subject 2100 can be measured by projecting light with a predetermined pattern onto the subject 2100 and analyzing the degree of distortion of the pattern.

[0299] On the other hand, using stereoscopic vision, for example, the distance between the light detection system 2000 and the subject can be measured by using two or more cameras and acquiring two or more images of the subject 2100 viewed from two or more different viewpoints. Note that the light emission device 2001 and the light detection device 2002 can be synchronously controlled by the system control unit 2003.

[0300] <4. Application Examples>

[0301] (Examples of applications involving moving objects)

[0302] The technology disclosed herein (the Technology) can be applied to a variety of products. For example, the Technology disclosed herein can be implemented as a device to be installed on any type of mobile body such as a car, electric car, hybrid electric car, motorcycle, bicycle, personal mobility device, airplane, unmanned aerial vehicle, ship or robot.

[0303] Figure 36 This is a block diagram illustrating a schematic configuration example of a vehicle control system, which is an example of a mobile body control system to which the technology is applicable according to the embodiments of this disclosure.

[0304] The vehicle control system 12000 includes multiple electronic control units interconnected via a communication network 12001. Figure 36 In the example shown, the vehicle control system 12000 includes a drive system control unit 12010, a main system control unit 12020, an external information detection unit 12030, an internal information detection unit 12040, and a comprehensive control unit 12050. Furthermore, as functional components of the comprehensive control unit 12050, a microcomputer 12051, an audio / image output unit 12052, and an in-vehicle network interface (I / F) 12053 are shown.

[0305] The drive system control unit 12010 controls the operation of devices related to the vehicle's drive system according to various programs. For example, the drive system control unit 12010 is used as a control device such as a drive force generating device for generating drive force for a vehicle such as an internal combustion engine or a drive motor, a drive force transmission mechanism for transmitting drive force to the wheels, a steering mechanism for adjusting the vehicle's steering angle, and a braking device for generating braking force for the vehicle.

[0306] The main system control unit 12020 controls the operation of various devices installed on the vehicle body according to various programs. For example, the main system control unit 12020 is used as a control device for keyless entry systems, smart key systems, power windows, or various lights such as headlights, taillights, brake lights, turn signals, and fog lights. In this case, radio waves transmitted from a portable device or signals from various switches, used instead of buttons, can be input to the main system control unit 12020. The main system control unit 12020 receives the input radio waves or signals and controls the vehicle's door locking devices, power windows, lights, etc.

[0307] The exterior information detection unit 12030 detects information related to the exterior of the vehicle, including information from the vehicle control system 12000. For example, the exterior information detection unit 12030 is connected to the imaging unit 12031. The exterior information detection unit 12030 causes the imaging unit 12031 to capture images of the exterior of the vehicle and receives the captured images. Based on the received images, the exterior information detection unit 12030 can perform processing such as detecting objects like people, cars, obstacles, signs, and text on the road, or detecting their distance.

[0308] The imaging unit 12031 is an optical sensor that receives light and outputs an electrical signal corresponding to the amount of light received. The imaging unit 12031 can output an electrical signal as an image, or it can output an electrical signal as information related to the measured distance. In addition, the light received by the imaging unit 12031 can be visible light, or it can be invisible light such as infrared light.

[0309] The in-vehicle information detection unit 12040 detects information related to the interior of the vehicle. For example, the in-vehicle information detection unit 12040 is connected to a driver state detection unit 12041 that detects the driver's state. For example, the driver state detection unit 12041 includes a camera that captures images of the driver. Based on the detection information input from the driver state detection unit 12041, the in-vehicle information detection unit 12040 can calculate the driver's fatigue level or concentration level, or determine whether the driver is asleep in a seated position.

[0310] The microcomputer 12051 can calculate control target values ​​for the drive force generating device, steering mechanism, or braking device based on information about the vehicle's interior and exterior obtained by the external information detection unit 12030 or the internal information detection unit 12040, and can output control commands to the drive system control unit 12010. For example, the microcomputer 12051 can perform coordinated control to implement functions of advanced driver assistance systems (ADAS), including collision avoidance or collision mitigation, following distance-based driving, vehicle speed maintenance, vehicle collision warning, and vehicle lane departure warning.

[0311] In addition, the microcomputer 12051 can coordinate and control the drive force generating device, steering mechanism, braking device, etc., based on information about the exterior or interior of the vehicle obtained by the external information detection unit 12030 or the internal information detection unit 12040, so as to realize autonomous driving, where the vehicle drives itself without relying on the operation of the driver.

[0312] In addition, the microcomputer 12051 can output control commands to the main system control unit 12020 based on information about the vehicle's external environment obtained by the external information detection unit 12030. For example, the microcomputer 12051 controls the headlights according to the position of the vehicle in front or oncoming vehicles detected by the external information detection unit 12030 to perform coordinated control, thereby achieving glare prevention such as switching the high beams to low beams.

[0313] The sound / image output unit 12052 transmits at least one of sound and image output signals to an output device capable of visually or audibly informing vehicle occupants or the outside of the vehicle. Figure 36 In the example, an audio speaker 12061, a display unit 12062, and a dashboard 12063 are shown as output devices. For example, the display unit 12062 may include at least one of an in-vehicle display and a head-up display.

[0314] Figure 37 This is a diagram showing an example of the mounting location of the imaging unit 12031.

[0315] exist Figure 37In the imaging unit 12031, there are imaging units 12101, 12102, 12103, 12104 and 12105.

[0316] Imaging units 12101, 12102, 12103, 12104, and 12105 are installed, for example, at the front of vehicle 12100, in the side mirrors, rear bumper, and rear door, as well as on the upper side of the windshield inside the vehicle. Imaging unit 12101 in the front of the vehicle and imaging unit 12105 on the upper side of the windshield inside the vehicle primarily acquire images of the front of vehicle 12100. Imaging units 12102 and 12103 in the side mirrors primarily acquire images of the sides of vehicle 12100. Imaging unit 12104 in the rear bumper or rear door primarily acquires images of the rear of vehicle 12100. Imaging unit 12105 on the upper side of the windshield inside the vehicle is mainly used to detect vehicles, pedestrians, obstacles, traffic signals, traffic signs, lanes, etc., ahead.

[0317] Incidentally, Figure 37 Examples of the imaging ranges of imaging units 12101 to 12104 are shown. Imaging range 12111 represents the imaging range of imaging unit 12101 located at the front of the vehicle. Imaging ranges 12112 and 12113 represent the imaging ranges of imaging units 12102 and 12103 located in the side mirrors, respectively. Imaging range 12114 represents the imaging range of imaging unit 12104 located in the rear bumper or rear door. For example, by superimposing the image data captured by imaging units 12101 to 12104 onto each other, a bird's-eye view of the vehicle 12100 as seen from above is obtained.

[0318] At least one of the imaging units 12101 to 12104 may have the function of acquiring distance information. For example, at least one of the imaging units 12101 to 12104 may be a stereo camera composed of multiple imaging elements, or may be an imaging element having pixels for phase difference detection.

[0319] For example, based on distance information obtained from imaging units 12101-12104, microcomputer 12051 can determine the distance to each three-dimensional object within the imaging range 12111-12114 and the time change of that distance (relative speed relative to vehicle 12100), thereby extracting the three-dimensional object located on the driving path of vehicle 12100, particularly the closest three-dimensional object, that is traveling in approximately the same direction as vehicle 12100 at a predetermined speed (e.g., 0 km / h or more), as the vehicle ahead. Furthermore, microcomputer 12051 can set a pre-determined distance between vehicles in front of the vehicle ahead and can perform automatic braking control (including tracking stop control), automatic acceleration control (including tracking start control), etc. Therefore, coordinated control for autonomous driving, etc., aimed at autonomous vehicle operation without relying on driver operation, is possible.

[0320] For example, based on distance information obtained from imaging units 12101-12104, microcomputer 12051 can classify three-dimensional object data into three-dimensional object data for two-wheeled vehicles, ordinary vehicles, large vehicles, pedestrians, utility poles, and other three-dimensional objects, extract the classified three-dimensional object data, and use the extracted three-dimensional object data to automatically avoid obstacles. For example, microcomputer 12051 identifies obstacles around vehicle 12100 as obstacles that the driver of vehicle 12100 can visually recognize and obstacles that the driver of vehicle 12100 cannot visually recognize. Then, microcomputer 12051 determines the collision risk, indicating the degree of danger of colliding with each obstacle. When the collision risk is equal to or higher than a set value and there is a possibility of collision, microcomputer 12051 outputs a warning to the driver via audio speaker 12061 and display unit 12062, or performs forced deceleration or evasive steering via drive system control unit 12010. Microcomputer 12051 can assist driving to avoid collisions.

[0321] At least one of the imaging units 12101-12104 can be an infrared camera that detects infrared light. For example, the microcomputer 12051 can identify a pedestrian by determining whether a pedestrian exists in the images captured by the imaging units 12101-12104. For example, pedestrian identification is performed by extracting feature points from the images captured by the imaging units 12101-12104, which are infrared cameras, and by performing pattern matching processing on a series of feature points indicating the outline of an object to determine whether the object is a pedestrian. When the microcomputer 12051 determines that a pedestrian exists in the images captured by the imaging units 12101-12104 and thereby identifies the pedestrian, the sound / image output unit 12052 controls the display unit 12062 to display a quadrilateral outline for emphasis, superimposed on the identified pedestrian. The sound / image output unit 12052 can also control the display unit 12062 to display an icon or similar indicating the pedestrian at a desired location.

[0322] Examples of vehicle control systems to which the technology according to embodiments of the present disclosure is applicable have been described above. For example, the technology according to embodiments of the present disclosure can be applied to the imaging unit 12031 in the above-described configuration. Specifically, imaging device 1, etc., can be applied to the imaging unit 12031. The application of the technology according to the present disclosure to the imaging unit 12031 enables the acquisition of high-resolution captured images. This allows for high-precision control using the captured images in a moving body control system.

[0323] (Examples of the application of endoscopic surgical systems)

[0324] The technology disclosed herein (the Technology) can be applied to a variety of products. For example, the Technology disclosed herein can be applied to endoscopic surgical systems.

[0325] Figure 38 This is a diagram illustrating an example of a schematic configuration of an endoscopic surgical system to which the technology (the technology) according to embodiments of the present disclosure can be applied.

[0326] exist Figure 38 The image shows a surgeon (physician) 11131 performing surgery on a patient 11132 on a bed 11133 using an endoscopic surgical system 11000. As shown, the endoscopic surgical system 11000 includes an endoscope 11100, other surgical instruments 11110 such as a pneumoperitoneum tube 11111 and an energy delivery device 11112, a support arm assembly 11120 supporting the endoscope 11100 thereon, and a trolley 11200 on which various devices for endoscopic surgery are mounted.

[0327] Endoscope 11100 includes a lens tube 11101 having a region at a predetermined distance distal to its end that is inserted into a body cavity of patient 11132, and a camera 11102 connected to the proximal end of the lens tube 11101. In the example shown in the figures, an endoscope 11100 comprising a rigid endoscope with a rigid lens tube 11101 is illustrated. However, endoscope 11100 may also include a flexible endoscope with a flexible lens tube 11101.

[0328] The lens tube 11101 has an opening at its distal end into which an objective lens is fitted. A light source device 11203 is connected to the endoscope 11100, such that light generated by the light source device 11203 is guided through a light guide extending inside the lens tube 11101 to the distal end of the lens tube, and then directed via the objective lens toward the object being observed within the body cavity of the patient 11132. Note that the endoscope 11100 can be a direct-viewing endoscope, or it can be an oblique-viewing endoscope or a side-viewing endoscope.

[0329] An optical system and an imaging element are housed inside the camera 11102, such that reflected light from the observed object (observation light) is focused onto the imaging element by the optical system. The observation light is photoelectrically converted by the imaging element to generate an electrical signal corresponding to the observation light, i.e., an image signal corresponding to the observed image. The image signal is transmitted as RAW data to the camera control unit (CCU) 11201.

[0330] The CCU 11201 includes a central processing unit (CPU), a graphics processing unit (GPU), etc., and comprehensively controls the operation of the endoscope 11100 and the display device 11202. Furthermore, for example, the CCU 11201 receives image signals from the camera 11102 and performs various types of image processing, such as image processing (de-mosaic processing), to display an image based on the image signal.

[0331] The display device 11202 displays an image based on an image signal that has been image-processed by the CCU 11201 under the control of the CCU 11201.

[0332] For example, the light source device 11203 includes a light source such as a light-emitting diode (LED) and supplies illumination light to the endoscope 11100 when photographing the surgical area.

[0333] Input device 11204 is an input interface for endoscopic surgical system 11000. Users can input various types of information or commands into endoscopic surgical system 11000 via input device 11204. For example, users can input commands to change the imaging conditions of endoscope 11100 (type of illumination light, magnification, focal length, etc.).

[0334] The treatment device control unit 11205 controls the drive of the energy treatment device 11112 for purposes such as tissue cauterization or incision, and sealing of blood vessels. The pneumoperitoneum device 11206 injects gas into the patient's body cavity 11132 via the pneumoperitoneum tube 11111 to inflate the cavity, ensuring the field of vision of the endoscope 11100 and ensuring the surgeon's working space. The recorder 11207 is a device capable of recording various types of information related to the surgery. The printer 11208 is a device capable of printing various types of information related to the surgery in various formats such as text, images, and graphics.

[0335] Note that, for example, the light source device 11203 supplied to the endoscope 11100 when photographing the surgical area may include an LED, a laser light source, or a combination thereof as a white light source. In the case where the white light source includes a combination of red, green, and blue (RGB) laser light sources, the white balance adjustment of the captured image can be performed by the light source device 11203 because the output intensity and timing of each color (wavelength) can be controlled with high precision. Furthermore, in this case, if lasers from each RGB laser source are emitted onto the object of observation in a time-division manner and the driving of the imaging element of the camera 11102 is controlled synchronously with the emission timing, images corresponding to RGB colors can be captured in a time-division manner. According to this method, color images can be obtained even if a color filter is not provided for the imaging element.

[0336] Furthermore, the light source device 11203 can be controlled to change the intensity of the light to be output at various preset intervals. By controlling the driving of the imaging element of the camera 11102 in sync with the timing of the change in light intensity to acquire and synthesize images in a time-segmented manner, high dynamic range images without underexposed shadows or overexposed highlights can be generated.

[0337] Furthermore, the light source device 11203 can supply light in a predetermined wavelength band corresponding to special light observation. In special light observation, for example, narrow-band imaging (narrow-band imaging) is performed by emitting light with a narrow band range compared to the illumination light used in ordinary observation (i.e., white light) by utilizing the wavelength dependence of light absorption in body tissues. Additionally, in special light observation, fluorescence observation is performed to obtain images from fluorescence generated by emitting excitation light. In fluorescence observation, for example, excitation light can be irradiated onto body tissue to observe fluorescence from the body tissue (autofluorescence observation), or a reagent such as indocyanine green (ICG) can be locally injected into the body tissue and excitation light corresponding to the fluorescence wavelength of the reagent can be emitted to obtain a fluorescence image. The light source device 11203 can supply narrow-band light and / or excitation light suitable for the aforementioned special light observation.

[0338] Figure 39 It is shown Figure 38 The block diagram shown illustrates an example of the functional configuration of the camera 11102 and CCU 11201.

[0339] Camera 11102 includes a lens unit 11401, an imaging unit 11402, a driving unit 11403, a communication unit 11404, and a camera control unit 11405. CCU 11201 includes a communication unit 11411, an image processing unit 11412, and a control unit 11413. Camera 11102 and CCU 11201 are connected via a transmission cable 11400 for communication with each other.

[0340] Lens unit 11401 is an optical system disposed at the connection portion with lens barrel 11101. Observation light received from the distal end of lens barrel 11101 is guided to camera 11102 and incident on lens unit 11401. Lens unit 11401 includes a combination of multiple lenses, including zoom lenses and focal lenses.

[0341] Imaging unit 11402 includes imaging elements. The number of imaging elements included in imaging unit 11402 can be one (single-plate type) or multiple (multi-plate type). When imaging unit 11402 is configured as multi-plate type, for example, image signals corresponding to each RGB are generated by the imaging elements, and a color image can be obtained by synthesizing the image signals. Alternatively, imaging unit 11402 can also be configured to have a pair of imaging elements for acquiring image signals for the right and left eyes for three-dimensional (3D) display. If 3D display is performed, the surgeon 11131 can more accurately grasp the depth of body tissue in the surgical site. Note that when imaging unit 11402 is configured as multi-plate type, multiple lens units 11401 are provided corresponding to each imaging element.

[0342] Furthermore, the imaging unit 11402 does not necessarily have to be mounted on the camera 11102. For example, the imaging unit 11402 can be mounted directly behind the objective lens inside the lens barrel 11101.

[0343] The drive unit 11403 includes an actuator, and under the control of the camera control unit 11405, moves the zoom lens and focus lens of the lens unit 11401 a predetermined distance along the optical axis. Therefore, the magnification and focus of the image captured by the imaging unit 11402 can be appropriately adjusted.

[0344] The communication unit 11404 includes a communication device for transmitting and receiving various types of information to and from the CCU 11201. The communication unit 11404 transmits image signals acquired from the imaging unit 11402 as RAW data to the CCU 11201 via the transmission cable 11400.

[0345] Additionally, the communication unit 11404 receives control signals from the CCU 11201 for controlling the camera 11102 and supplies these control signals to the camera control unit 11405. The control signals include information related to imaging conditions, such as information specifying the frame rate of the captured image, information specifying the exposure value during imaging, and / or information specifying the magnification and focus of the captured image.

[0346] Note that imaging conditions such as frame rate, exposure value, magnification, and focus can be appropriately specified by the user, or can be automatically set by the control unit 11413 of CCU 11201 based on the acquired image signal. In the latter case, the automatic exposure (AE) function, automatic focus (AF) function, and automatic white balance (AWB) function are integrated into the endoscope 11100.

[0347] The camera control unit 11405 controls the driving of the camera 11102 based on the control signal received from the CCU 11201 via the communication unit 11404.

[0348] The communication unit 11411 includes a communication device for transmitting and receiving various types of information to and from the camera 11102. The communication unit 11411 receives image signals transmitted from the camera 11102 via a transmission cable 11400.

[0349] In addition, the communication unit 11411 transmits control signals for controlling the camera 11102 to the camera 11102. Image signals and control signals can be transmitted via electrical communication, optical communication, etc.

[0350] The image processing unit 11412 performs various types of image processing on the image signal in RAW data form transmitted from the camera 11102.

[0351] The control unit 11413 performs various types of control related to imaging the surgical area, etc., via the endoscope 11100 and displaying the images captured by imaging the surgical area, etc. For example, the control unit 11413 generates control signals for controlling the drive of the camera 11102.

[0352] Furthermore, the control unit 11413 controls the display device 11202 to display captured images of the surgical area, etc., based on image signals that have already been processed by the image processing unit 11412. In this case, the control unit 11413 can identify various objects within the captured images using various image recognition techniques. For example, the control unit 11413 can detect the edge shape and / or color of objects contained in the captured images to identify surgical instruments such as forceps, specific living body sites, bleeding, fog when using the energy treatment device 11112, etc. When controlling the display device 11202 to display the captured images, the control unit 11413 can use the recognition results to make the display device 11202 display various types of surgical support information with images of the surgical area in an overlay manner. When surgical support information is displayed in an overlay and presented to the surgeon 11131, the burden on the surgeon 11131 can be reduced, and the surgeon 11131 can perform the surgery reliably.

[0353] The transmission cable 11400 that connects the camera 11102 and the CCU 11201 to each other is an electrical signal cable for communication of electrical signals, an optical fiber for communication of optical signals, or a composite cable for both electrical signals and optical communication.

[0354] Here, in the example shown in the attached figure, communication is performed via wired communication using transmission cable 11400, but communication between camera 11102 and CCU 11201 can be performed wirelessly.

[0355] Examples of endoscopic surgical systems to which the technology of this disclosure is applicable have been described above. For example, the technology of this disclosure is applicable to the imaging unit 11402 in the camera 11102 of the endoscope 11100 as described above. The application of the technology of this disclosure to the imaging unit 11402 enables the endoscope 11100 to provide high-definition images.

[0356] The present disclosure has been described above through embodiments, modifications, applicable examples, and application examples; however, the present technology is not limited to the above embodiments, and various modifications are possible. For example, the above modifications have been described as modifications of the above embodiments; furthermore, the configurations of the various modifications can be appropriately combined.

[0357] In the above embodiments, the imaging device is described as an example; however, the light detection device of this disclosure can be any type of device that receives incident light and converts the light into electrical charge. The signal to be output can be an image information signal or a ranging information signal. The light detection device (imaging device) can be applied to image sensors, ranging sensors, etc. It should be noted that this disclosure is not limited to back-illuminated image sensors, but is also applicable to front-illuminated image sensors.

[0358] The optical detection device according to this disclosure can also be used as a ranging sensor, which is capable of distance measurement via time-of-flight (TOF). The optical detection device (imaging device) can also be used as a sensor configured to detect events, such as an event-driven sensor (called an event vision sensor (EVS), event-driven sensor (EDS), dynamic vision sensor (DVS), etc.).

[0359] The light detection device according to an embodiment of this disclosure includes: a first photoelectric conversion element and a second photoelectric conversion element, each photoelectric conversion element having a photoelectric conversion film for performing photoelectric conversion of light; and a readout circuit including a first floating diffuser electrically connected to the first photoelectric conversion element and a second floating diffuser electrically connected to the second photoelectric conversion element, and capable of outputting a signal based on charge accumulated in the first floating diffuser. The readout circuit includes a first transistor capable of electrically connecting the first floating diffuser and the second floating diffuser. Therefore, a light detection device advantageous for miniaturization can be obtained.

[0360] Note that the effects described in this specification are merely illustrative and are not limited to those described above; other effects may also be provided. Furthermore, this disclosure may also take the following forms.

[0361] (1) A light detection device, comprising:

[0362] A first photoelectric conversion element and a second photoelectric conversion element, each having a photoelectric conversion film that performs photoelectric conversion of light; and

[0363] The readout circuit includes a first floating diffuser electrically connected to a first photoelectric conversion element and a second floating diffuser electrically connected to a second photoelectric conversion element, and is capable of outputting a signal based on the charge accumulated in the first floating diffuser.

[0364] The readout circuit includes a first transistor capable of electrically connecting the first floating diffuser and the second floating diffuser.

[0365] (2) The optical detection device according to (1) further includes:

[0366] A pixel, comprising at least one of a first photoelectric conversion element or a second photoelectric conversion element.

[0367] The pixels mentioned include those that can be used for phase difference detection.

[0368] (3) The optical detection device according to (1) or (2), wherein

[0369] The photoelectric conversion film contains organic materials.

[0370] (4) The light detection device according to any one of (1) to (3), wherein

[0371] The readout circuit is capable of outputting a first signal based on the charge converted by the first photoelectric conversion element and a second signal based on the charge converted by the first photoelectric conversion element and the charge converted by the second photoelectric conversion element.

[0372] (5) The optical detection device according to (4) further includes:

[0373] The calculation circuit is capable of generating a third signal based on the charge converted by the second photoelectric conversion element, based on the first and second signals.

[0374] (6) The optical detection device according to (4) or (5) further includes:

[0375] An AD conversion circuit capable of performing AD conversion.

[0376] The calculation circuit is capable of generating a third signal based on a first signal and a second signal that have been converted into digital signals by the AD conversion circuit.

[0377] (7) The light detection apparatus according to any one of (1) to (6) further includes:

[0378] A semiconductor layer, which includes at least a portion of the readout circuit, is configured to be stacked on a layer including a first photoelectric conversion element and a second photoelectric conversion element.

[0379] (8) The optical detection device according to (7) further includes:

[0380] A through electrode is configured to penetrate the semiconductor layer and is capable of transmitting the charge converted by the first photoelectric conversion element.

[0381] (9) The optical detection device according to (7) or (8), wherein

[0382] The semiconductor layer has a first surface and a second surface opposite to the first surface. Light transmitted through a first photoelectric conversion element or a second photoelectric conversion element is incident on the first surface, and

[0383] The first transistor is disposed on the second side of the semiconductor layer.

[0384] (10) The light detection apparatus according to any one of (7) to (9), wherein

[0385] The semiconductor layer has a first surface and a second surface opposite to the first surface. Light transmitted through a first photoelectric conversion element or a second photoelectric conversion element is incident on the first surface, and

[0386] The first transistor includes a thin-film transistor and is disposed on the first side of the semiconductor layer.

[0387] (11) The light detection apparatus according to any one of (7) to (10) further includes:

[0388] A wiring layer is disposed between the layer including the first photoelectric conversion element and the second photoelectric conversion element and the semiconductor layer.

[0389] The first transistor includes a thin-film transistor and is disposed in the wiring layer.

[0390] (12) The light detection apparatus according to any one of (7) to (11) further includes:

[0391] A third photoelectric conversion element is disposed in the semiconductor layer.

[0392] The readout circuit includes a second transistor capable of transferring the charge converted by the third photoelectric conversion element to the first floating diffuser.

[0393] (13) The optical detection device according to (12) further includes:

[0394] A fourth photoelectric conversion element is disposed adjacent to the third photoelectric conversion element in the semiconductor layer.

[0395] The readout circuit includes a third transistor capable of transferring the charge converted by the fourth photoelectric conversion element to the first floating diffuser.

[0396] (14) The optical detection device according to (13), wherein

[0397] The third photoelectric conversion element receives light transmitted through at least one of the first or second photoelectric conversion elements, and

[0398] The fourth photoelectric conversion element receives light that has passed through at least one of the second photoelectric conversion element or the first photoelectric conversion element.

[0399] (15) The light detection apparatus according to any one of (1) to (14) further includes:

[0400] The third transistor is electrically connected to the second floating diffuser and is capable of discharging overflow charge.

[0401] (16) The light detection apparatus according to any one of (1) to (16) further includes:

[0402] An amplifier circuit that outputs a first voltage based on the signal output from the readout circuit and a reference voltage.

[0403] The readout circuit includes a fourth transistor capable of resetting the voltage of the first floating diffuser based on a first voltage output from the amplifier circuit.

[0404] (17) The light detection apparatus according to any one of (1) to (16), wherein

[0405] The readout circuit includes multiple capacitive elements capable of holding a voltage signal based on the charge accumulated in the first floating diffuser.

[0406] (18) The light detection apparatus according to any one of (1) to (17), wherein

[0407] The readout circuit includes a fourth transistor electrically connected between the first floating diffuser and the first potential line, and

[0408] The readout circuit is able to output a signal based on the voltage of the first floating diffuser when the fourth transistor is in the on state before and after the charge accumulation period.

[0409] (19) A light detection system, comprising:

[0410] Optical detection device; and

[0411] Calculation device,

[0412] The light detection device includes:

[0413] A first photoelectric conversion element and a second photoelectric conversion element, each having a photoelectric conversion film that performs photoelectric conversion of light;

[0414] The readout circuit includes a first floating diffuser electrically connected to a first photoelectric conversion element and a second floating diffuser electrically connected to a second photoelectric conversion element, and is capable of outputting a signal based on the charge accumulated in the first floating diffuser; and

[0415] An AD conversion circuit capable of performing AD conversion.

[0416] The readout circuit includes a first transistor capable of electrically connecting the first floating diffuser and the second floating diffuser, and is capable of outputting a first signal based on the charge converted by the first photoelectric conversion element and a second signal based on the charge converted by the first photoelectric conversion element and the charge converted by the second photoelectric conversion element.

[0417] The computing device is capable of generating a third signal based on the charge converted by the second photoelectric conversion element, based on a first signal and a second signal converted into digital signals by the AD conversion circuit.

[0418] (20) An electronic device comprising:

[0419] A first photoelectric conversion element and a second photoelectric conversion element, each having a photoelectric conversion film that performs photoelectric conversion of light; and

[0420] The readout circuit includes a first floating diffuser electrically connected to a first photoelectric conversion element and a second floating diffuser electrically connected to a second photoelectric conversion element, and is capable of outputting a signal based on the charge accumulated in the first floating diffuser.

[0421] The readout circuit includes a first transistor capable of electrically connecting the first floating diffuser and the second floating diffuser.

[0422] This application claims priority based on Japanese Patent Application No. 2024-093348, filed with the Japan Patent Office on June 7, 2024, the entire contents of which are incorporated herein by reference.

[0423] It should be understood that those skilled in the art can conceive of various modifications, combinations, sub-combinations and alterations based on design requirements and other factors, and that such modifications, combinations and alterations fall within the scope of the appended claims or their equivalents.

Claims

1. A light detection device, comprising: A first photoelectric conversion element and a second photoelectric conversion element, each having a photoelectric conversion film that performs photoelectric conversion of light; and The readout circuit includes a first floating diffuser electrically connected to a first photoelectric conversion element and a second floating diffuser electrically connected to a second photoelectric conversion element, and is capable of outputting a signal based on the charge accumulated in the first floating diffuser. The readout circuit includes a first transistor capable of electrically connecting the first floating diffuser and the second floating diffuser.

2. The optical detection device according to claim 1, further comprising: A pixel, comprising at least one of a first photoelectric conversion element or a second photoelectric conversion element. The pixels mentioned include those that can be used for phase difference detection.

3. The optical detection device according to claim 1, The photoelectric conversion film contains organic materials.

4. The optical detection device according to claim 1, The readout circuit is capable of outputting a first signal based on the charge converted by the first photoelectric conversion element and a second signal based on the charge converted by the first photoelectric conversion element and the charge converted by the second photoelectric conversion element.

5. The optical detection device according to claim 4, further comprising: The calculation circuit is capable of generating a third signal based on the charge converted by the second photoelectric conversion element, based on the first and second signals.

6. The optical detection device according to claim 5, further comprising: An AD conversion circuit capable of performing AD conversion. The calculation circuit is capable of generating a third signal based on a first signal and a second signal that have been converted into digital signals by the AD conversion circuit.

7. The optical detection device according to claim 1, further comprising: A semiconductor layer, which includes at least a portion of the readout circuit, is configured to be stacked on a layer including a first photoelectric conversion element and a second photoelectric conversion element.

8. The optical detection device according to claim 7, further comprising: A through electrode is configured to penetrate the semiconductor layer and is capable of transmitting the charge converted by the first photoelectric conversion element.

9. The optical detection device according to claim 7, The semiconductor layer has a first surface and a second surface opposite to the first surface. Light transmitted through a first photoelectric conversion element or a second photoelectric conversion element is incident on the first surface, and The first transistor is disposed on the second side of the semiconductor layer.

10. The optical detection device according to claim 7, The semiconductor layer has a first surface and a second surface opposite to the first surface. Light transmitted through a first photoelectric conversion element or a second photoelectric conversion element is incident on the first surface, and The first transistor includes a thin-film transistor and is disposed on the first side of the semiconductor layer.

11. The optical detection device according to claim 7, further comprising: A wiring layer is disposed between the layer including the first photoelectric conversion element and the second photoelectric conversion element and the semiconductor layer. The first transistor includes a thin-film transistor and is disposed in the wiring layer.

12. The optical detection device according to claim 7, further comprising: A third photoelectric conversion element is disposed in the semiconductor layer. The readout circuit includes a second transistor capable of transferring the charge converted by the third photoelectric conversion element to the first floating diffuser.

13. The optical detection device according to claim 12, further comprising: A fourth photoelectric conversion element is disposed adjacent to the third photoelectric conversion element in the semiconductor layer. The readout circuit includes a third transistor capable of transferring the charge converted by the fourth photoelectric conversion element to the first floating diffuser.

14. The optical detection device according to claim 13, The third photoelectric conversion element receives light transmitted through at least one of the first or second photoelectric conversion elements, and The fourth photoelectric conversion element receives light that has passed through at least one of the second photoelectric conversion element or the first photoelectric conversion element.

15. The optical detection device according to claim 1, further comprising: The third transistor is electrically connected to the second floating diffuser and is capable of discharging overflow charge.

16. The optical detection device according to claim 1, further comprising: An amplifier circuit that outputs a first voltage based on the signal output from the readout circuit and a reference voltage. The readout circuit includes a fourth transistor capable of resetting the voltage of the first floating diffuser based on a first voltage output from the amplifier circuit.

17. The optical detection device according to claim 1, The readout circuit includes multiple capacitive elements capable of holding a voltage signal based on the charge accumulated in the first floating diffuser.

18. The optical detection device according to claim 1, The readout circuit includes a fourth transistor electrically connected between the first floating diffuser and the first potential line, and The readout circuit is able to output a signal based on the voltage of the first floating diffuser when the fourth transistor is in the on state before and after the charge accumulation period.

19. A light detection system, comprising: Optical detection device; and computing device, The light detection device includes: A first photoelectric conversion element and a second photoelectric conversion element, each having a photoelectric conversion film that performs photoelectric conversion of light; The readout circuit includes a first floating diffuser electrically connected to a first photoelectric conversion element and a second floating diffuser electrically connected to a second photoelectric conversion element, and is capable of outputting a signal based on the charge accumulated in the first floating diffuser; and An AD conversion circuit capable of performing AD conversion. The readout circuit includes a first transistor capable of electrically connecting the first floating diffuser and the second floating diffuser, and is capable of outputting a first signal based on the charge converted by the first photoelectric conversion element and a second signal based on the charge converted by the first photoelectric conversion element and the charge converted by the second photoelectric conversion element. The computing device is capable of generating a third signal based on the charge converted by the second photoelectric conversion element, based on a first signal and a second signal converted into digital signals by the AD conversion circuit.

20. An electronic device, comprising: A first photoelectric conversion element and a second photoelectric conversion element, each having a photoelectric conversion film that performs photoelectric conversion of light; and The readout circuit includes a first floating diffuser electrically connected to a first photoelectric conversion element and a second floating diffuser electrically connected to a second photoelectric conversion element, and is capable of outputting a signal based on the charge accumulated in the first floating diffuser. The readout circuit includes a first transistor capable of electrically connecting the first floating diffuser and the second floating diffuser.

Citation Information

Patent Citations

  • Solid state image pickup device, driving method of the same, and electronic apparatus

    JP2016058559A

  • Toothbrush stand

    JP2024093348A