Image sensor and image pickup device

The image sensor dynamically adjusts membrane voltage and analog range based on pixel signal brightness to enhance image quality by mitigating noise and dark current issues, ensuring high-quality infrared imaging.

JP7577643B2Active Publication Date: 2024-11-05SONY SEMICON SOLUTIONS CORP
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2021504891
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2019-03-11
Filing Date
2020-02-21
Publication Date
2024-11-05
Estimated Expiration
2040-02-21

AI Technical Summary

Technical Problem

Existing infrared image sensors experience deterioration in image quality due to factors such as optical shot noise and dark current, which are not effectively addressed by current technologies.

Method used

The image sensor incorporates a voltage control mechanism that adjusts the membrane voltage and analog range of the photoelectric conversion units based on pixel signal brightness, using a membrane voltage control section and an analog range control section to optimize image quality by dynamically adjusting the control voltage and analog range in response to varying light conditions.

Benefits of technology

This approach enhances the signal-to-noise ratio and prevents image quality deterioration by optimizing the membrane voltage and analog range, thereby improving the overall image quality of the sensor.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007577643000001
    Figure 0007577643000001
  • Figure 0007577643000002
    Figure 0007577643000002
  • Figure 0007577643000003
    Figure 0007577643000003
Patent Text Reader

Abstract

An imaging element according to an embodiment of the present disclosure is provided with a plurality of sensor pixels and a voltage control unit. Each of the sensor pixels includes a photoelectric conversion part and a read circuit which outputs a pixel signal based on a charge output from the photoelectric conversion part. The voltage control unit applies a control voltage based on the pixel signal to a plurality of photoelectric conversion parts.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to an imaging element and an imaging device. [Background technology]

[0002] In recent years, imaging elements (infrared sensors) having sensitivity in the infrared region have been commercialized. For example, Patent Document 1 describes that such infrared sensors use III-V group semiconductors such as InGaAs (indium gallium arsenide) as photoelectric conversion sections. In this photoelectric conversion section, infrared rays are absorbed to generate electric charges. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication WO2017 / 150167 Summary of the Invention

[0004] In such an imaging element, it is desirable to suppress deterioration in image quality, and therefore it is desirable to provide an imaging element and an imaging apparatus capable of suppressing deterioration in image quality.

[0005] An imaging element according to an embodiment of the present disclosure includes a plurality of sensor pixels and a voltage control unit. Each sensor pixel includes a photoelectric conversion unit and a readout circuit that outputs a pixel signal based on the charge output from the photoelectric conversion unit. The voltage control unit applies a control voltage based on the pixel signal to each photoelectric conversion unit.

[0006] An imaging device according to an embodiment of the present disclosure includes an imaging element and an image quality control circuit. The imaging element has a plurality of sensor pixels. Each sensor pixel includes a photoelectric conversion unit and a readout circuit that outputs a pixel signal based on the charge output from the photoelectric conversion unit. The image quality control circuit applies a control voltage based on the pixel signal to each photoelectric conversion unit.

[0007] In the imaging element and imaging device according to an embodiment of the present disclosure, a control voltage based on a pixel signal is applied to each photoelectric conversion unit, thereby controlling the image quality of image data obtained by the imaging element, and therefore image quality adjustment can be performed according to the magnitude of the luminance of the image data, compared to the case where a fixed voltage is applied to each photoelectric conversion unit. [Brief description of the drawings]

[0008] [Figure 1] 1 is a diagram illustrating an example of a schematic configuration of an imaging element according to a first embodiment of the present disclosure. [Diagram 2] 2 is a diagram illustrating an example of a circuit configuration of a sensor pixel in FIG. 1. [Diagram 3] 2 is a diagram illustrating an example of a perspective configuration of the imaging element in FIG. 1. [Figure 4] 4 is a diagram illustrating an example of a cross-sectional configuration of the imaging element in FIG. 3. [Diagram 5] 2A is a diagram illustrating an example of the relationship between the membrane voltage and the charge that can be held in the image sensor of FIG 1. FIG. 2B is a diagram illustrating an example of the relationship between the analog range of an ADC and the amplitude of a pixel signal. [Figure 6] 2 is a diagram illustrating an example of the relationship between the membrane voltage and noise of the image sensor of FIG. 1. [Figure 7] 2 is a diagram illustrating an example of an image quality adjustment procedure for the image sensor of FIG. 1. [Figure 8] 2 is a diagram illustrating a modified example of the schematic configuration of the image sensor in FIG. [Figure 9] 2 is a diagram illustrating a modified example of the schematic configuration of the image sensor in FIG. [Figure 10] 1 is a diagram illustrating an example of a relationship between an analog range of an ADC and the amplitude of a pixel signal. [Figure 11] 10 is a diagram illustrating an example of an image quality adjustment procedure for the image sensor of FIG. [Figure 12] FIG. 10 is a diagram illustrating a modified example of the schematic configuration of the image sensor in FIG. [Figure 13] FIG. 10 is a diagram illustrating a modified example of the schematic configuration of the image sensor in FIG. [Figure 14] 2 is a diagram illustrating a modified example of the schematic configuration of the image sensor in FIG. [Figure 15]15 is a diagram illustrating an example of a circuit configuration of a sensor pixel in FIG. 14. [Figure 16] 1 is a diagram illustrating an example of a relationship between an analog range of an ADC and the amplitude of a pixel signal. [Figure 17] 15 is a diagram illustrating an example of an image quality adjustment procedure for the image sensor of FIG. 14. [Figure 18] FIG. 15 is a diagram illustrating a modified example of the schematic configuration of the image sensor in FIG. [Figure 19] FIG. 15 is a diagram illustrating a modified example of the schematic configuration of the image sensor in FIG. [Figure 20] 3 is a diagram illustrating a modified example of the circuit configuration of the sensor pixel in FIG. 2. [Figure 21] 16 is a diagram illustrating a modified example of the circuit configuration of the sensor pixel in FIG. 15. [Figure 22] 3 is a diagram illustrating a modified example of the circuit configuration of the sensor pixel in FIG. 2. [Diagram 23] 16 is a diagram illustrating a modified example of the circuit configuration of the sensor pixel in FIG. 15. [Figure 24] 4 is a diagram illustrating a modified example of the cross-sectional configuration of the image sensor in FIG. 3. [Diagram 25] 2 is a diagram illustrating an example of a planar configuration of the imaging element in FIG. 1. [Figure 26] 26 is a diagram illustrating an example of a cross-sectional configuration of the imaging element of FIG. 25 taken along line AA. [Figure 27] 11 is a diagram illustrating an example of a schematic configuration of an imaging device according to a second embodiment of the present disclosure. [Figure 28] 28 is a diagram illustrating an example of an imaging procedure in the imaging device of FIG. 27. [Figure 29] FIG. 28 is a diagram illustrating a modified example of the schematic configuration of the imaging device in FIG. [Diagram 30] 1 is a block diagram showing an example of a schematic configuration of a vehicle control system; [Diagram 31] 4 is an explanatory diagram showing an example of the installation positions of an outside-vehicle information detection unit and an imaging unit; FIG. [Diagram 32] 1 is a diagram illustrating an example of a schematic configuration of an endoscopic surgery system. [Diagram 33] 2 is a block diagram showing an example of a functional configuration of a camera head and a CCU. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. The description will be made in the following order. 1. First embodiment (imaging element)...FIGS. 1 to 7 2. Modification of the first embodiment (imaging element)...FIGS. 8 to 26 3. Second embodiment (imaging device)...FIGS. 27 and 28 4. Modification of the second embodiment (imaging device)...FIG. 29 5. Application Examples Application example 1 (moving object)…Fig. 30, Fig. 31 Application example 2 (surgical system)…Fig. 32, Fig. 33

[0010] <1. First embodiment> [composition] An image sensor 1 according to a first embodiment of the present disclosure will be described. FIG. 1 illustrates an example of a schematic configuration of the image sensor 1. The image sensor 1 is, for example, an infrared image sensor, and is sensitive to light with a wavelength of, for example, 800 nm or more. The image sensor 1 includes a pixel array section 10 in which a plurality of sensor pixels 11, each including a photoelectric conversion element, are two-dimensionally arranged in a matrix. As shown in FIG. 2, the sensor pixel 11 includes, for example, a pixel circuit 14 that performs photoelectric conversion, and a readout circuit 15 that outputs a pixel signal based on the charge output from the pixel circuit 14.

[0011] The pixel circuit 14 includes, for example, a photodiode PD, a transfer transistor TRG, a floating diffusion FD, and a discharge transistor OFG. The transfer transistor TRG and the discharge transistor OFG are, for example, NMOS (Metal Oxide Semiconductor) transistors. The photodiode PD corresponds to a specific example of a "photoelectric conversion unit" in the present disclosure.

[0012] The photodiode PD is a photoelectric conversion unit that absorbs light of a predetermined wavelength (for example, light of a wavelength in the infrared region of 900 nm to 1700 nm) and generates a signal charge. The photodiode PD is configured to include, for example, a compound semiconductor such as a III-V group semiconductor. Examples of III-V group semiconductors used in the photodiode PD include InGaP, InAlP, InGaAs, InAlAs, and a compound semiconductor with a chalcopyrite structure. A compound semiconductor with a chalcopyrite structure is a material that provides a high light absorption coefficient and high sensitivity over a wide wavelength range, and is preferably used as an n-type semiconductor material for photoelectric conversion. The photodiode PD may be configured to include amorphous silicon (Si), germanium (Ge), a quantum dot photoelectric conversion film, an organic photoelectric conversion film, and the like, in addition to the above-mentioned compound semiconductors.

[0013] The cathode of the photodiode PD is connected to the source of the transfer transistor TRG, and the anode of the photodiode PD is connected to a power supply line to which a voltage Vtop is applied. The drain of the transfer transistor TRG is connected to the floating diffusion FD, and the gate of the transfer transistor TRG is connected to the pixel drive line 12.

[0014] The transfer transistor TRG is connected between the cathode of the photodiode PD and the floating diffusion FD, and transfers the charge held in the photodiode PD to the floating diffusion FD in response to a control signal applied to the gate electrode. The drain of the transfer transistor TRG is electrically connected to the floating diffusion FD, and the gate of the transfer transistor TRG is connected to the pixel drive line 12.

[0015] The floating diffusion FD is a floating diffusion region that temporarily holds the charge transferred from the photodiode PD via the transfer transistor TRG. The floating diffusion FD is connected to, for example, a readout circuit 15 and is also connected to the vertical signal line 13 via the readout circuit 15. The floating diffusion FD is connected to the input terminal of the readout circuit 15.

[0016] The drain of the emission transistor OFG is connected to a power supply line to which a voltage Vdr is applied, and the source is connected to the cathode of the photodiode PD. The emission transistor OFG initializes (resets) the charge of the photodiode PD in response to a control signal applied to the gate electrode.

[0017] The readout circuit 15 has, for example, a reset transistor RST, a selection transistor SEL, and an amplification transistor AMP. The source of the reset transistor RST (the input terminal of the readout circuit 15) is connected to the floating diffusion FD, and the drain of the reset transistor RST is connected to a power supply line VDD and the drain of the amplification transistor AMP. The gate of the reset transistor RST is connected to the pixel drive line 12. The source of the amplification transistor AMP is connected to the drain of the selection transistor SEL, and the gate of the amplification transistor AMP is connected to the source of the reset transistor RST. The source of the selection transistor SEL (the output terminal of the readout circuit 15) is connected to the vertical signal line 13, and the gate of the selection transistor SEL is connected to the pixel drive line 12.

[0018] The reset transistor RST initializes (resets) the potential of the floating diffusion FD to a predetermined potential. When the reset transistor RST is turned on, the potential of the floating diffusion FD is reset to the potential of the power supply line VDD. The selection transistor SEL controls the output timing of the pixel signal from the readout circuit 15. The amplification transistor AMP generates, as the pixel signal, a signal whose voltage corresponds to the level of the charge held in the floating diffusion FD. That is, the amplification transistor AMP generates, as the pixel signal, a signal whose voltage corresponds to the amount of light received by the sensor pixel 11. The amplification transistor AMP constitutes a source follower type amplifier, and outputs a pixel signal whose voltage corresponds to the level of the charge generated in the photodiode PD. When the selection transistor SEL is turned on, the amplification transistor AMP amplifies the potential of the floating diffusion FD and outputs a voltage corresponding to the potential to a horizontal selection circuit 40 described later via the vertical signal line 13.

[0019] The selection transistor SEL may be provided between the power supply line VDD and the amplification transistor AMP. In this case, the drain of the reset transistor RST is connected to the power supply line VDD and the drain of the selection transistor SEL. The source of the selection transistor SEL is connected to the drain of the amplification transistor AMP, and the gate of the selection transistor SEL is connected to the pixel drive line 12. The source of the amplification transistor AMP (the output terminal of the readout circuit 15) is connected to the vertical signal line 13, and the gate of the amplification transistor AMP is connected to the source of the reset transistor RST.

[0020] 3, the imaging element 1 includes two substrates (a light receiving substrate 100 and a driving substrate 200). The imaging element 1 includes a three-dimensional structure formed by bonding together the two substrates (the light receiving substrate 100 and the driving substrate 200).

[0021] The light receiving substrate 100 is a substrate on which a plurality of photodiodes PD are formed in a matrix on a silicon (Si) substrate. The upper surface of the light receiving substrate 100 (the surface opposite to the driving substrate 200) is a light receiving surface 100A. The driving substrate 200 is a substrate on which a pixel signal generating circuit region 200A and a peripheral circuit region 200B are formed on a Si substrate. In the pixel signal generating circuit region 200A, a plurality of pixel signal generating circuits 45 are formed in a matrix. Each pixel signal generating circuit 45 is a circuit of the sensor pixel 11 excluding the photodiode PD. In the peripheral circuit region 200B, a logic circuit for processing pixel signals is formed, and for example, a vertical driving circuit 20, a horizontal driving circuit 30, a horizontal selection circuit 40, a system control circuit 50, a membrane voltage control unit 60, and a voltage generating circuit 70 are formed. That is, the imaging element 1 includes a pixel array section 10, a vertical driving circuit 20, a horizontal driving circuit 30, a horizontal selection circuit 40, a system control circuit 50, a membrane voltage control unit 60, and a voltage generating circuit 70. The logic circuit outputs a pixel signal (digital value) for each sensor pixel 11 to the outside.

[0022] Based on the master clock, the system control circuit 50 generates clock signals and control signals that serve as the basis for the operation of the vertical drive circuit 20, the horizontal drive circuit 30, the horizontal selection circuit 40, the membrane voltage control unit 60, etc., and provides these signals to the vertical drive circuit 20, the horizontal selection circuit 40, the membrane voltage control unit 60, etc.

[0023] The vertical drive circuit 20 is configured, for example, by a shift register and controls row scanning of the plurality of sensor pixels 11 via the plurality of pixel drive lines 12. The horizontal selection circuit 40 is, for example, a circuit in which an ADC 40a and a switch element 40b are provided for each pixel column (or each vertical signal line 13) of the pixel array unit 10. The ADC 40a performs AD (Analog-to-Digital) conversion of the pixel signal. The ADC 40a is capable of varying the analog range R, and sets the analog range R based on a range setting value input from outside. In this embodiment, the analog range R is set to Ra.

[0024] The input terminal of the ADC 40a is connected to the vertical signal line 13, and the output terminal of the ADC 40a is connected to the switch element 40b. The horizontal drive circuit 30 is configured, for example, with a shift register or the like, and drives each switch element 40b of the horizontal selection circuit 40 in sequence. By driving each switch element 40b in sequence by the horizontal drive circuit 30, each pixel signal transmitted through each vertical signal line 13 is output in sequence to the horizontal signal line 40c and input to a DSP circuit or the like.

[0025] The membrane voltage control unit 60 controls the membrane voltage Vf applied to each photodiode PD based on the pixel signal obtained from the sensor pixel 11. The membrane voltage control unit 60 outputs a control signal for controlling the membrane voltage Vf to the voltage generation circuit 70. The voltage generation circuit 70 generates analog voltages (voltages Vtop and Vdr) based on the control signal input from the membrane voltage control unit 60, and applies them to each photodiode PD via a power supply line. In other words, the membrane voltage control unit 60 and the voltage generation circuit 70 apply the membrane voltage Vf based on the pixel signal obtained from the sensor pixel 11 to each photodiode PD, thereby controlling the image quality of the image data obtained from the pixel signal.

[0026] 4 shows an example of a cross-sectional configuration of the image sensor 1. In the image sensor 1, the light receiving substrate 100 has an n-type semiconductor film 21 which is a photoelectric conversion section (photodiode PD). The n-type semiconductor film 21 is formed on the entire surface of the pixel array section 10, and is made of, for example, the materials mentioned above as materials used for the photodiode PD. In the following, other configurations will be described assuming that the n-type semiconductor film 21 is made of InGaAs.

[0027] The light receiving substrate 100 further includes a p-type semiconductor layer 22 for each sensor pixel 11, the p-type semiconductor layer 22 being in contact with the surface of the n-type semiconductor film 21 on the driving substrate 200 side. Each p-type semiconductor layer 22 is formed of a high-concentration p-type semiconductor, for example, p-type InGaAs. The p-type semiconductor layer 22 functions as an electrode (second electrode) of the photodiode PD. A predetermined voltage Vdr is applied to the p-type semiconductor layer 22 via the discharge transistor OFG in the on state, and a voltage Vdd of the power supply line VDD is applied to the p-type semiconductor layer 22 via the transfer transistor TRG and the reset transistor RST in the on state. The light receiving substrate 100 further includes an n-type semiconductor layer 23 that separates the p-type semiconductor layers 22 from each other. The n-type semiconductor layer 23 is formed in the same layer as the p-type semiconductor layers 22, and is formed of, for example, n-type InP.

[0028] The light-receiving substrate 100 further includes an n-type semiconductor layer 24 in contact with the surface of the n-type semiconductor film 21 on the light-receiving surface 100A side. The n-type semiconductor layer 24 is formed of an n-type semiconductor having a higher concentration than the n-type semiconductor film 21, and is formed of, for example, n-type InGaAs, n-type InP, or n-type InAlAs. The n-type semiconductor layer 24 functions as a barrier layer that prevents the backflow of charges generated in the n-type semiconductor film 21. The light-receiving substrate 100 further includes an anti-reflection film 25 in contact with the surface of the n-type semiconductor layer 24 on the light-receiving surface 100A side. The anti-reflection film 25 is formed of, for example, silicon nitride (SiN), hafnium oxide (HfO2), aluminum oxide (Al2O3), zirconium oxide (ZrO2), tantalum oxide (Ta2Ta5), titanium oxide (TiO2), or the like. The n-type semiconductor layer 24 also functions as an upper electrode (first electrode) of the electrodes vertically sandwiching the n-type semiconductor film 21. A predetermined voltage Vtop is applied to the upper electrode.

[0029] The light receiving substrate 100 further has a color filter 26 and an on-chip lens 27 on the anti-reflection film 25. The color filter 26 is composed of a plurality of filters 26R that selectively transmit red light, a plurality of filters 26G that selectively transmit green light, and a plurality of filters 26G that selectively transmit blue light. The plurality of filters 26R, 26G, and 26B are provided for each sensor pixel 11, and are arranged, for example, in a Bayer array in a plane parallel to the light receiving surface 100A. In FIG. 4, the sensor pixel 11 provided with the filter 26R is represented as 11R, the sensor pixel 11 provided with the filter 26G is represented as 11G, and the sensor pixel 11 provided with the filter 26B is represented as 11B. The color filter 26 may be omitted as necessary.

[0030] The light receiving substrate 100 further has a passivation layer 28 and an insulating layer 29 below the p-type semiconductor layer 22 and the n-type semiconductor layer 23. The light receiving substrate 100 further has a connection electrode 31 penetrating the passivation layer 28 and contacting the p-type semiconductor layer 22, and a bump electrode 32 penetrating the insulating layer 29 and contacting the connection electrode 31. One pair of the connection electrode 31 and the bump electrode 32 is provided for each sensor pixel 11. The bump electrode 32 is bonded to a connection layer 43 (described later) of the drive substrate 200 and is electrically connected to the connection layer 43. For example, the bump electrode 32 is bonded to the connection layer 43 of the drive substrate 200 when the light receiving substrate 100 and the drive substrate 200 are bonded to each other.

[0031] The driving substrate 200 includes a support substrate 41 and an interlayer insulating layer 42. The support substrate 41 is made of, for example, a silicon (Si) substrate. The interlayer insulating layer 42 is made of, for example, a silicon (Si) substrate. 29(light-receiving substrate 100). In the interlayer insulating layer 42, for example, a plurality of connection layers 43, a plurality of read electrodes 44, a plurality of pixel signal generating circuits 45, and a plurality of wirings 46 are provided in order from the position closest to the light-receiving substrate 100. A plurality of sets of connection layers 43, read electrodes 44, pixel signal generating circuits 45, and wirings 46 are provided for each sensor pixel 11. A plurality of interlayer insulating layers 42 in the interlayer insulating layer 42 are provided in, for example, a ROIC (Read Out IC) for reading out charges from each photodiode PD. In the driving substrate 200, the above-mentioned logic circuit is provided in a portion of the interlayer insulating layer 42 corresponding to the peripheral circuit region 200B.

[0032] Fig. 5(A) shows an example of the relationship between the membrane voltage Vf applied to the photodiode PD and the charge Qs that can be held in the photodiode PD. Fig. 5(B) shows an example of the relationship between the analog range (dynamic range) of the ADC 40a and the amplitude Vd of the pixel signal. Fig. 5(B) shows an example of the relationship between the analog range of the ADC 40a and the amplitude Vd of the pixel signal.

[0033] From FIG. 5(A), it can be seen that as the voltage (film voltage Vf=Vtop-Vdr) applied to the photodiode PD (n-type semiconductor film 21) increases, the amount of charge Qs that can be held in the photodiode PD (n-type semiconductor film 21) also increases. As the amount of charge Qs held in the photodiode PD (n-type semiconductor film 21) increases, the amplitude Vd of the pixel signal also increases. However, as shown in FIG. 5(B), it is essential that the average value Vdavg (described later) of the amplitude Vd of the pixel signal does not exceed the voltage Vda corresponding to the analog range Ra of the ADC 40a. When the average value Vdavg of the amplitude Vd of the pixel signal exceeds the voltage Vda corresponding to the analog range Ra of the ADC 40a, the ADC 40a is saturated, and the output of the ADC 40a becomes a constant value.

[0034] Fig. 6 shows an example of the relationship between the membrane voltage Vf applied to the photodiode PD and the noise (dark current) generated in the photodiode PD. From Fig. 6, it can be seen that as the voltage (membrane voltage Vf = Vtop - Vdr) applied to the photodiode PD (n-type semiconductor film 21) increases, the level of the noise (dark current) generated in the photodiode PD increases exponentially. Therefore, at high luminance, the optical shot noise becomes dominant, so the membrane voltage Vf is set higher, and at low luminance, the noise (dark current) becomes dominant, so the membrane voltage Vf is set lower, so degradation of image quality can be suppressed.

[0035] [Picture Adjustment] Next, the image quality adjustment procedure of the imaging element 1 will be described with reference to FIG. 7. FIG. 7 shows an example of the image quality adjustment procedure of the imaging element 1. When the system control circuit 50 receives an imaging command, it outputs a membrane voltage setting command to the membrane voltage control unit 60. When the membrane voltage control unit 60 receives the membrane voltage setting command, it first sets the membrane voltage Vf to Vfa (step S101). Specifically, the membrane voltage control unit 60 sets Vtop and Vdr so that the potential difference (Vtop-Vdr) between Vtop (first voltage) and Vdr (second voltage) is Vfa. For example, the membrane voltage control unit 60 sets Vtop to +2V and Vdr to +1V. The membrane voltage control unit 60 outputs the set values ​​of Vtop and Vdr to the voltage generation circuit 70. Based on the setting value input from the membrane voltage control unit 60, the voltage generating circuit 70 applies a voltage of Vtop=+2V to the power supply line connected to the anode of the photodiode PD, and applies a voltage of Vdr=+1V to the power supply line connected to the drain of the emission transistor OFG.

[0036] Next, the membrane voltage control unit 60 judges whether the average value Vdavg of the pixel signals obtained from the sensor pixels 11 in the target area of ​​the pixel array unit 10 exceeds a predetermined threshold value Vth1 (first threshold value) (step S102). The threshold value Vth1 is a threshold value for judging whether the optical shot noise is dominant when the membrane voltage Vf is set to Vfa. As a result, if the average value Vdavg exceeds the predetermined threshold value Vth1, the membrane voltage control unit 60 sets the membrane voltage Vf to Vfb (Vfb>Vfa) (step S103). That is, the membrane voltage control unit 60 makes the membrane voltage Vf relatively larger than Vfa. Specifically, the membrane voltage control unit 60 sets Vtop and Vdr based on the average value Vdavg so that Vtop-Vdr becomes Vfb. For example, the membrane voltage control unit 60 sets Vtop to +3V and Vdr to +1V. The membrane voltage control unit 60 outputs the set values ​​of Vtop and Vdr to the voltage generating circuit 70. Based on the setting value input from the membrane voltage control unit 60, the voltage generating circuit 70 applies a voltage of Vtop=+3V to the power supply line connected to the anode of the photodiode PD, and applies a voltage of Vdr=+1V to the power supply line connected to the drain of the emission transistor OFG.

[0037] When the average value Vdavg is less than or equal to a predetermined threshold value Vth1, and when the film voltage Vf is set to Vfb (Vfb > Vfa), the film voltage control unit 60 determines whether the average value Vdavg is less than a predetermined threshold value Vth2 (second threshold value) (Vth2 < Vth1) (step S104). The threshold value Vth2 is a threshold value for determining whether the pixel signal is buried in noise. As a result, when the average value Vdavg is less than the predetermined threshold value Vth2, the film voltage control unit 60 sets the film voltage Vf to Vfc (Vfc < Vfa) (step S105). That is, the film voltage control unit 60 makes the film voltage Vf relatively smaller than Vfa. Specifically, the film voltage control unit 60 sets Vtop and Vdr based on the average value Vdavg such that Vtop - Vdr becomes Vfc. On the other hand, when the average value Vdavg is greater than or equal to the predetermined threshold value Vth2, the film voltage control unit 60 keeps the set value of the voltage as it is. When the system control circuit 50 receives an imaging end command, it ends the imaging and also ends the image quality adjustment of the imaging device 1 (step S106). When the system control circuit 50 has not received an imaging end command, it instructs the film voltage control unit 60 to execute again from step S102. In this way, the image quality adjustment of the imaging device 1 is performed.

[0038] [Effect] In this embodiment, the film voltage Vf based on the output of the imaging device 1 (average value Vdavg of the amplitude Vd of the pixel signal) is applied to each photodiode PD (n-type semiconductor film 21), thereby controlling the image quality of the image data obtained from the pixel signal. Specifically, when the output of the imaging device 1 (average value Vdavg of the amplitude Vd of the pixel signal) exceeds the threshold value Vth1, the film voltage Vf is made relatively large, and when the output of the imaging device 1 (average value Vdavg of the amplitude Vd of the pixel signal) is less than the threshold value Vth2, the film voltage Vf is made relatively small. Thus, in this embodiment, at high brightness, the film voltage Vf is made relatively large to reduce the influence of optical shot noise, and at low brightness, the film voltage Vf is made relatively small to increase the S / N ratio. Thereby, image quality degradation can be suppressed.

[0039] In this embodiment, the voltages Vtop and Vdr are generated based on the pixel signal so that the potential difference (Vtop-Vdr) between the voltages Vtop and Vdr becomes the membrane voltage Vf. The membrane voltage Vf thus generated is applied to each photodiode PD (n-type semiconductor film 21), thereby suppressing image quality degradation.

[0040] In this embodiment, each pixel circuit 14 is provided with a photodiode PD (n-type semiconductor film 21), a transfer transistor TRG, and a discharge transistor OFG. When the discharge transistor is on, Vdr is applied to the p-type semiconductor layer 22. This causes a film voltage Vf to be applied to each photodiode PD (n-type semiconductor film 21) based on the pixel signal. This makes it possible to suppress image quality degradation.

[0041] <2. Modification of the First Embodiment> [[Variation A]] In the above embodiment, the membrane voltage control unit 60 and the voltage generating circuit 70 are provided in the image sensor 1, but they may be provided in an image quality control circuit 2 separate from the image sensor 1, as shown in FIG. 8. In this case, the membrane voltage control unit 60 may set the membrane voltage Vf based on the output of the image sensor 1, as shown in FIG. 8. Even in this case, the same effects as those of the above embodiment are achieved.

[0042] [[Variation B]] In the above embodiment, the imaging element 1 may further include an analog range control unit 80, for example, as shown in Fig. 9. The analog range control unit 80 controls the analog range R of the ADC 40a based on the determination result input from the membrane voltage control unit 60 (i.e., the output of the imaging element 1 (average value Vdavg of the amplitude Vd of the pixel signal)). Specifically, the analog range control unit 80 controls the image quality of the image data obtained from the pixel signal by outputting a range setting value based on the determination result input from the membrane voltage control unit 60 (i.e., the output of the imaging element 1 (average value Vdavg of the amplitude Vd of the pixel signal)) to the ADC 40a.

[0043] Fig. 10 shows an example of the relationship between the analog range R (dynamic range) of the ADC 40a and the amplitude Vd of the pixel signal. Fig. 10 illustrates a case where the analog range R of the ADC 40a is set to Ra or Rb.

[0044] 10, when the average value Vdavg of the amplitude Vd of the pixel signal exceeds the voltage Vda corresponding to the analog range Ra of the ADC 40a, the ADC 40a becomes saturated. However, by expanding the analog range R of the ADC 40a from Ra to Rb, the average value Vdavg of the amplitude Vd of the pixel signal falls below the voltage Vdb corresponding to the analog range Rb of the ADC 40a, and the saturation of the ADC 40a is eliminated. Therefore, when the luminance is high, the dynamic range R of the ADC 40a is set high to prevent whiteout, and when the luminance is low, noise (dark current) becomes dominant, so that the dynamic range R of the ADC 40a is set low to suppress image quality degradation.

[0045] [Picture Adjustment] Next, an image quality adjustment procedure of the image sensor 1 according to this modified example will be described with reference to Fig. 11. Fig. 11 shows an example of an image quality adjustment procedure of the image sensor 1 according to this modified example. In this modified example, the image sensor 1 executes the image quality adjustment procedure described in Fig. 11 as well as the image quality adjustment procedure described in Fig. 7.

[0046] The analog range control unit 80 first sets the analog range R of the ADC 40a to Ra (step S201). Specifically, the analog range control unit 80 outputs a control signal to the ADC 40a to set the analog range R to Ra. When the control signal to set the analog range R to Ra is input from the analog range control unit 80, the ADC 40a sets the analog range R to Ra.

[0047] Next, when the determination result input from the membrane voltage control unit 60 is "Vdavg > Vth3", the analog range control unit 80 sets the analog range R to Rb (Rb > Ra) (steps S202, 203). That is, the analog range control unit 80 makes the analog range R relatively larger than Ra. The threshold value Vth3 (the first threshold value) is a threshold value for determining whether an image has a white skip when the membrane voltage Vf is set to Vfa. At this time, the analog range control unit 80 outputs a control signal for setting the analog range R to Rb to the ADC 40a. When a control signal for setting the analog range R to Rb is input from the analog range control unit 80, the ADC 40a sets the analog range R to Rb.

[0048] When the determination result input from the membrane voltage control unit 60 is "Vdavg ≤ Vth3", or when the analog range R is set to Rb, the analog range control unit 80 waits for the determination result regarding the magnitude relationship between the average value Vdavg and the threshold value Vth2 to be input from the membrane voltage control unit 60. At this time, when the determination result input from the membrane voltage control unit 60 is "Vdavg < Vth2" (Vth2 < Vth3), the analog range control unit 80 sets the analog range R to Ra (steps S204, 201). That is, the analog range control unit 80 makes the analog range R relatively smaller than Rb. Specifically, the analog range control unit 80 outputs a control signal for setting the analog range R to Ra to the ADC 40a. When a control signal for setting the analog range R to Ra is input from the analog range control unit 80, the ADC 40a sets the analog range R to Ra.

[0049] When the determination result input from the membrane voltage control unit 60 is "Vdavg ≥ Vth2", and when an imaging end command has not been input, the analog range control unit 80 executes step S202 (steps S204, 205). When an imaging end command is input, the analog range control unit 80 ends the setting of the analog range R (step S205). In this way, the image quality adjustment of the imaging device 1 is performed.

[0050] [effect] In this modification, the quality of the image data obtained from the pixel signal is controlled by applying a membrane voltage Vf based on the output of the image sensor 1 (average value Vdavg of the amplitude Vd of the pixel signal) to each photodiode PD (n-type semiconductor film 21). Specifically, when the output of the image sensor 1 (average value Vdavg of the amplitude Vd of the pixel signal) exceeds a threshold value Vth1, the membrane voltage Vf is made relatively large, and when the output of the image sensor 1 (average value Vdavg of the amplitude Vd of the pixel signal) falls below a threshold value Vth2, the membrane voltage Vf is made relatively small. Thus, in this modification, when the luminance is high, the membrane voltage Vf is made relatively large to reduce the effect of the optical shot noise, and when the luminance is low, the membrane voltage Vf is made relatively small to increase the S / N ratio. This makes it possible to suppress deterioration of image quality.

[0051] In this modification, the image quality of the image data obtained from the pixel signal is controlled by further outputting a range setting value based on the pixel signal to the ADC 40a. Specifically, when the output of the image sensor 1 (average value Vdavg of the amplitude Vd of the pixel signal) exceeds a threshold value Vth3, the range setting value is made relatively large, and when the output of the image sensor 1 (average value Vdavg of the amplitude Vd of the pixel signal) falls below a threshold value Vth2, the range setting value is made relatively small. In this manner, in this modification, when the luminance is high, the range setting value is made relatively large to prevent the image from becoming overexposed, and when the luminance is low, the range setting value is made relatively small to increase the S / N ratio. This makes it possible to prevent image quality deterioration.

[0052] [[Variation C]] In the above modification B, the membrane voltage control section 60, the voltage generating circuit 70, and the analog range control section 80 are provided in the image sensor 1, but they may be provided in an image quality control circuit 2 separate from the image sensor 1, as shown in Fig. 12. In this case, the membrane voltage control section 60 may set the membrane voltage Vf based on the output of the image sensor 1, as shown in Fig. 12. Even in this case, the same effect as the above embodiment can be achieved.

[0053] [[Variation D]] In the above modification B, the membrane voltage control section 60, the voltage generating circuit 70, and the analog range control section 80 are provided in the image sensor 1. However, for example, as shown in FIG. 13, the membrane voltage control section 60 and the voltage generating circuit 70 may be provided in an image quality control circuit 2 separate from the image sensor 1, and the analog range control section 80 may be provided in the image sensor 1.

[0054] In this case, the membrane voltage control unit 60 may set the membrane voltage Vf based on the output of the image sensor 1, for example, as shown in Fig. 13. Also, the analog range control unit 80 may set the analog range R of the ADC 40a based on the value of the output voltage (Vtop, Vdr) of the voltage generating circuit 70, for example, as shown in Fig. 13.

[0055] In this modification, the film voltage Vf applied to each photodiode PD (n-type semiconductor film 21) is set based on the output of the image sensor 1, and the analog range R of the ADC 40a is set based on the value of the voltage (Vtop, Vdr) applied to each photodiode PD (n-type semiconductor film 21). This makes it possible to suppress image quality degradation.

[0056] [[Variation E]] In the above embodiment, the imaging element 1 may further include an efficiency conversion control unit 90, for example, as shown in Fig. 14. The efficiency conversion control unit 90 controls the conversion efficiency η of the pixel circuit 14 based on the determination result input from the membrane voltage control unit 60 (i.e., the output of the imaging element 1 (average value Vdavg of the amplitude Vd of the pixel signal)). Specifically, the efficiency conversion control unit 90 controls the image quality of image data obtained from the pixel signal by outputting a control signal based on the determination result input from the membrane voltage control unit 60 (i.e., the output of the imaging element 1 (average value Vdavg of the amplitude Vd of the pixel signal)) to a switch element SW described later.

[0057] 15 shows an example of a circuit configuration of a sensor pixel 11 according to this modification. In the sensor pixel 11 according to this modification, the pixel circuit 14 has a switch element SW connected to the floating diffusion FD and an auxiliary capacitance Ce connected in parallel to the capacitance (FD capacitance Cfd) of the floating diffusion FD via the switch element SW. The efficiency conversion control unit 90 controls the conversion efficiency η of the pixel circuit 14 by controlling the on / off of the switch element SW.

[0058] Fig. 16 shows an example of the relationship between the analog range R of the ADC 40a and the amplitude Vd of the pixel signal. Fig. 16 illustrates a case where the analog range R of the ADC 40a is set to Rb.

[0059] When the switch element SW is turned on by the control of the efficiency conversion control unit 90, a voltage generated by the charge stored in the FD capacitance Cfd and the auxiliary capacitance Ce, which are connected in parallel to each other, is input to the readout circuit 15. The conversion efficiency η of the pixel circuit 14 at this time is η1. When the switch element SW is turned off by the control of the efficiency conversion control unit 90, the auxiliary capacitance Ce is separated from the floating diffusion FD, so that a voltage generated by the charge stored in the FD capacitance Cfd is input to the readout circuit 15. The conversion efficiency η2 of the pixel circuit 14 at this time is η1 / α. Here, α is (Cfd+Ce) / Cfd). That is, by turning off the switch element SW, the conversion efficiency η is reduced by 1 / α. For example, when the auxiliary capacitance Ce has a capacity twice that of the FD capacitance Cfd, the conversion efficiency η2 is 1 / 3 times the conversion efficiency η1. When the conversion efficiency η is reduced, for example, as shown in FIG. 16, the amplitude Vd of the pixel signal is reduced by the amount of the reduction in the conversion efficiency η. Therefore, for example, if the average value Vdavg1 when the switch element SW is on is greater than the voltage value Vdb corresponding to the upper limit (Rb) of the analog range R of the ADC 40a and the ADC 40a is saturated, by turning off the switch element SW, the average value Vdavg2 when the switch element SW is off becomes Vdavg1 / α, and can be made smaller than the voltage value Vdb. Therefore, at high luminance, in order to prevent whiteout, the conversion efficiency η is set low, and at low luminance, since noise (dark current) becomes dominant, the conversion efficiency η is set high, thereby suppressing degradation in image quality.

[0060] [Picture Adjustment] Next, the image quality adjustment procedure of the imaging element 1 will be described with reference to Fig. 17. Fig. 17 shows an example of the image quality adjustment procedure of the imaging element 1. In this modification, the imaging element 1 executes the image quality adjustment procedure described in Fig. 17 as well as the image quality adjustment procedure described in Fig. 7.

[0061] The efficiency conversion control unit 90 first sets the conversion efficiency η of the pixel circuit 14 to η1 (step S301). Specifically, the efficiency conversion control unit 90 outputs a control signal for turning on the switch element SW to the switch element SW in the pixel circuit 14. When a control signal for turning on the switch element SW is input from the efficiency conversion control unit 90, the switch element SW turns on. As a result, the FD capacitance Cfd and the auxiliary capacitance Ce are connected in parallel with each other.

[0062] Next, when the determination result input from the film voltage control unit 60 is "Vdavg > Vth3", the efficiency conversion control unit 90 sets the conversion efficiency η to η2 (η2 < η1) (steps S302, 303). At this time, the efficiency conversion control unit 90 outputs a control signal for turning off the switch element SW to the switch element SW. When a control signal for turning off the switch element SW is input from the efficiency conversion control unit 90, the switch element SW turns off. That is, the efficiency conversion control unit 90 turns off the switch element SW when the average value Vdavg exceeds Vth3. As a result, the auxiliary capacitance Ce is separated from the floating diffusion FD.

[0063] When the determination result input from the film voltage control unit 60 is "Vdavg ≤ Vth3", or when the switch element SW is set to off, the efficiency conversion control unit 90 waits for the determination result regarding the magnitude relationship between the average value Vdavg and the threshold value Vth2 (Vth2 < Vth3) to be input from the film voltage control unit 60. At this time, when the determination result input from the film voltage control unit 60 is "Vdavg < Vth2", the efficiency conversion control unit 90 sets the conversion efficiency η to η1 (steps S304, 301). Specifically, the efficiency conversion control unit 90 outputs a control signal for turning on the switch element SW to the switch element SW. When a control signal for turning on the switch element SW is input from the efficiency conversion control unit 90, the switch element SW turns on. That is, the efficiency conversion control unit 90 turns on the switch element SW when the average value Vdavg falls below Vth2 which is smaller than Vth3. As a result, the FD capacitance Cfd and the auxiliary capacitance Ce are connected in parallel with each other.

[0064] When the determination result input from the membrane voltage control unit 60 is "Vdavg≧Vth2", if an imaging end command has not been input, the efficiency conversion control unit 90 executes step S302 (steps S304, 302). When an imaging end command has been input, the efficiency conversion control unit 90 ends the setting of the conversion efficiency η (step S305). In this manner, image quality adjustment of the image sensor 1 is performed.

[0065] [effect] In this modification, the quality of the image data obtained from the pixel signal is controlled by applying a membrane voltage Vf based on the output of the image sensor 1 (average value Vdavg of the amplitude Vd of the pixel signal) to each photodiode PD (n-type semiconductor film 21). Specifically, when the output of the image sensor 1 (average value Vdavg of the amplitude Vd of the pixel signal) exceeds a threshold value Vth1, the membrane voltage Vf is made relatively large, and when the output of the image sensor 1 (average value Vdavg of the amplitude Vd of the pixel signal) falls below a threshold value Vth2, the membrane voltage Vf is made relatively small. Thus, in this modification, when the luminance is high, the membrane voltage Vf is made relatively large to reduce the effect of the optical shot noise, and when the luminance is low, the membrane voltage Vf is made relatively small to increase the S / N ratio. This makes it possible to suppress deterioration of image quality.

[0066] In this modification, a control signal based on the pixel signal is further output to the switch element SW, thereby controlling the image quality of the image data obtained from the pixel signal. Specifically, when the output of the image sensor 1 (average value Vdavg of the amplitude Vd of the pixel signal) exceeds a threshold value Vth3, the switch element SW is turned off, and when the output of the image sensor 1 (average value Vdavg of the amplitude Vd of the pixel signal) falls below a threshold value Vth2, the switch element SW is turned on. In this manner, in this modification, when the luminance is high, the switch element SW is turned off to prevent the image from becoming overexposed, and when the luminance is low, the switch element SW is turned on to increase the S / N ratio. This makes it possible to prevent deterioration in image quality.

[0067] [[Variation F]] In the above modification E, the membrane voltage control unit 60, the voltage generating circuit 70, and the efficiency conversion control unit 90 are provided in the image sensor 1. However, for example, as shown in FIG. 18, the membrane voltage control unit 60, the voltage generating circuit 70, and the efficiency conversion control unit 90 may be provided in an image quality control circuit 2 separate from the image sensor 1. In this case, for example, as shown in FIG. 18, the membrane voltage control unit 60 may set the membrane voltage Vf based on the output of the image sensor 1. Even in this case, the same effects as those of the above embodiment are achieved.

[0068] [[Variation G]] In the above modification E, the membrane voltage control unit 60, the voltage generating circuit 70, and the efficiency conversion control unit 90 are provided in the image sensor 1. However, for example, as shown in FIG. 19, the membrane voltage control unit 60 and the voltage generating circuit 70 may be provided in an image quality control circuit 2 separate from the image sensor 1, and the efficiency conversion control unit 90 may be provided in the image sensor 1.

[0069] In this case, the membrane voltage control unit 60 may set the membrane voltage Vf based on the output of the imaging element 1, for example, as shown in Fig. 19. Also, the efficiency conversion control unit 90 may set the conversion efficiency η of the pixel circuit 14 based on the value of the output voltage (Vtop, Vdr) of the voltage generating circuit 70, for example, as shown in Fig. 19.

[0070] In this modification, the film voltage Vf applied to the photodiode PD (n-type semiconductor film 21) is set based on the output of the image sensor 1, and the conversion efficiency η of the pixel circuit 14 is set based on the value of the voltage (Vtop, Vdr) applied to the photodiode PD (n-type semiconductor film 21). This makes it possible to suppress image quality degradation.

[0071] [[Variation H]] In the above-described embodiment and its modified examples, the pixel circuit 14 may omit the discharge transistor OFG, for example, as shown in Fig. 20 and Fig. 21. In this case, the membrane voltage control unit 60 may generate the voltage Vtop based on the pixel signal so that the potential difference (Vtop-Vdr) between the voltage Vtop applied to the n-type semiconductor layer 24 and the electrode Vdr of the p-type semiconductor layer 22 applied by the reset transistor RST when the transfer transistor TRG is on becomes the membrane voltage Vf.

[0072] In the above-described embodiment and its modified examples, the pixel circuit 14 may omit the discharge transistor OFG and the transfer transistor TRG, for example, as shown in Fig. 22 and Fig. 23. In this case, the membrane voltage control unit 60 may generate the voltage Vtop based on the pixel signal so that the potential difference (Vtop-Vdr) between the voltage Vtop applied to the n-type semiconductor layer 24 and the electrode Vdr of the p-type semiconductor layer 22 applied by the reset transistor RST becomes the membrane voltage Vf.

[0073] Even in these cases, the present modification provides the same effects as those of the image sensor 1 according to the above embodiment and its modifications.

[0074] [[Variation I]] In the above embodiment and its modified examples A to H, the light receiving substrate 100 and the driving substrate 200 are bump-bonded. However, in the above embodiment and its modified examples A to H, the light receiving substrate 100 and the driving substrate 200 may be Cu-Cu bonded. Fig. 24 shows a modified example of the cross-sectional configuration of the imaging element 1 according to this modified example.

[0075] The light-receiving substrate 100 has an insulating film 33, a buried layer 34, interlayer insulating films 35 and 36, a plurality of electrodes 37 and a plurality of contact electrodes 38 instead of the passivation layer 28, the insulating layer 29, the plurality of connection electrodes 31 and the plurality of bump electrodes 32.

[0076] The insulating film 33 covers the n-type semiconductor layer 23 and a part of each of the p-type semiconductor layers 22, and has an opening at a position facing each of the p-type semiconductor layers 22. The insulating film 33 is made of, for example, silicon oxide (SiO x ) or an oxide such as aluminum oxide (Al2O3). The insulating film 33 may be configured with a laminated structure made up of a plurality of films. The insulating film 33 may be configured with a silicon (Si)-based insulating material such as silicon oxynitride (SiON), carbon-containing silicon oxide (SiOC), silicon nitride (SiN), and silicon carbide (SiC). The insulating film 33 has a thickness of, for example, several tens to several hundreds of nm.

[0077] The electrodes 37 are provided in each opening of the insulating film 33, one for each p-type semiconductor layer 22. Each electrode 37 is in contact with a corresponding p-type semiconductor layer 22. Each electrode 37 is made of, for example, any one of titanium (Ti), tungsten (W), titanium nitride (TiN), platinum (Pt), gold (Au), germanium (Ge), palladium (Pd), zinc (Zn), nickel (Ni), and aluminum (Al), or an alloy containing at least one of them. Each electrode 37 may be a single film of such a constituent material, or may be a laminated film combining two or more kinds. For example, each electrode 37 is made of a laminated film of titanium and tungsten. The thickness of each electrode 37 is, for example, several tens of nm to several hundreds of nm.

[0078] The buried layer 34 is formed by burying each electrode 37. The surface of the buried layer 34 on the driving substrate 200 side is flat. The buried layer 34 is made of, for example, silicon oxide (SiO x ), silicon nitride (SiN), silicon oxynitride (SiON), silicon oxide containing carbon (SiOC), and silicon carbide (SiC).

[0079] The interlayer insulating films 35 and 36 are laminated in this order on the flat surface of the buried layer 34 on the drive substrate 200 side. The interlayer insulating films 35 and 36 are made of, for example, an inorganic insulating material. Examples of the inorganic insulating material include silicon nitride (SiN), aluminum oxide (Al2O3), silicon oxide (SiO2), and hafnium oxide (HfO2). The interlayer insulating films 35 and 36 may be made of the same inorganic insulating material.

[0080] A plurality of contact electrodes 38 are provided for each electrode 37. Each contact electrode 38 is in contact with a corresponding electrode 37. The surface of each contact electrode 38 facing the drive substrate 200 is exposed from the interlayer insulating film 36. The surface of each contact electrode 38 facing the drive substrate 200 and the surface of the interlayer insulating film 36 facing the drive substrate 200 are disposed in the same plane.

[0081] The driving substrate 200 has a plurality of contact electrodes 47 instead of the plurality of connection layers 43. The driving substrate 200 further has interlayer insulating films 48 and 49. The plurality of contact electrodes 47 are provided one for each read electrode 44. Each contact electrode 47 is in contact with a corresponding read electrode 44.

[0082] The interlayer insulating films 48 and 49 are laminated in this order on the surface of the interlayer insulating layer 42 facing the light-receiving substrate 100. The interlayer insulating films 48 and 49 are made of, for example, an inorganic insulating material. Examples of the inorganic insulating material include silicon nitride (SiN), aluminum oxide (Al2O3), silicon oxide (SiO2), and hafnium oxide (HfO2).

[0083] A surface of each contact electrode 47 facing the light-receiving substrate 100 is exposed from the interlayer insulating film 49. A surface of each contact electrode 47 facing the light-receiving substrate 100 and a surface of the interlayer insulating film 49 facing the light-receiving substrate 100 are disposed in the same plane. The contact electrodes 38 and 47 are made of, for example, copper (Cu). The contact electrode 38 and the contact electrode 47 are bonded to each other.

[0084] FIG. 25 shows an example of a planar configuration of the imaging element 1 according to this modified example. FIG. 26 shows an example of a cross-sectional configuration of the imaging element 1 of FIG. 25 taken along line AA. The imaging element 1 has a central element region R1 and a peripheral region R2 that is provided outside the element region R1 and surrounds the element region R1. The element region R1 corresponds to a location in the imaging element 1 where the n-type semiconductor film 21 (photodiode PD) is provided. The imaging element 1 has a conductive film 51 that is provided from the element region R1 to the peripheral region R2. The conductive film 51 has an opening in a region facing the central portion of the element region R1. A region of the element region R1 that is exposed from the conductive film 51 (a region facing the opening of the conductive film 51) is a light receiving region. A region of the element region R1 that is covered with the conductive film 51 is an OPB (Optical Black) region. The OPB region is provided so as to surround the light receiving region. The OPB region is used to obtain a black level pixel signal.

[0085] In the light-receiving substrate 100, the insulating film 33 covers the n-type semiconductor layer 23 and parts of each p-type semiconductor layer 22, and also covers the side surface of the n-type semiconductor film 21 (photodiode PD). In the light-receiving substrate 100, the buried layer 34 covers the side surface of the n-type semiconductor film 21 via the insulating film 33, and is provided from the element region R1 to the peripheral region R2. In the peripheral region R2, holes H1 and H2 that penetrate the light-receiving substrate 100 and reach the drive substrate 200 are provided.

[0086] The hole H1 is provided at a position closer to the element region R1 than the hole H2, and the sidewall and bottom surface of the hole H1 are covered with a conductive film 51. The hole H1 is for connecting the n-type semiconductor film 21 and the wiring 46 of the drive substrate 200, and is provided penetrating the antireflection film 25, the buried layer 34, the interlayer insulating film 35 and the interlayer insulating film 36.

[0087] Hole H2 is provided, for example, at a position closer to the end of the light receiving substrate 100 than hole H1. Hole H2 penetrates the anti-reflection film 25, the buried layer 34, the interlayer insulating film 35, and the interlayer insulating film 36, and reaches the wiring 46 of the driving substrate 200. An electrical connection between the outside and the imaging element 1 is made via hole H2. Holes H1 and H2 do not have to reach the driving substrate 200. For example, holes H1 and H2 may reach a wiring provided in the interlayer insulating film 36, and this wiring may be connected to the wiring 46 of the driving substrate 200.

[0088] In the light-receiving substrate 100, the interlayer insulating film 36, the interlayer insulating film 35, and the buried layer 34 are provided in this order from a position closest to the drive substrate 200. The interlayer insulating film 36, the interlayer insulating film 35, and the buried layer 34 are provided from the element region R1 to the peripheral region R2, and the interlayer insulating film 36 and each contact electrode 38 form a bonding surface with the drive substrate 200. The bonding surface of the light-receiving substrate 100 is provided in the element region R1 and the peripheral region R2, and the bonding surface of the element region R1 and the bonding surface of the peripheral region R2 form the same plane.

[0089] Of the multiple contact electrodes 38 provided on the light receiving substrate 100, the multiple contact electrodes 38 provided in the peripheral region R2 are dummy electrodes 38D that have no electrical connection with the n-type semiconductor film 21 (photodiode PD) and are provided for joining the light receiving substrate 100 and the driving substrate 200.

[0090] In the driving substrate 200, the interlayer insulating film 49, the interlayer insulating film 48, and the interlayer insulating layer 42 are provided in this order from a position closer to the light-receiving substrate 100. The interlayer insulating film 49, the interlayer insulating film 48, and the interlayer insulating layer 42 are provided from the element region R1 to the peripheral region R2, and the interlayer insulating film 49 and each contact electrode 47 form a bonding surface with the light-receiving substrate 100. The bonding surface of the driving substrate 200 is provided in the element region R1 and the peripheral region R2, and the bonding surface of the element region R1 and the bonding surface of the peripheral region R2 form the same plane.

[0091] Among the contact electrodes 47 provided on the driving substrate 200, the contact electrodes 47 provided in the peripheral region R2 are dummy electrodes 47D that are not electrically connected to the n-type semiconductor film 21 (photodiode PD) and are provided for bonding the light receiving substrate 100 and the driving substrate 200. The dummy electrodes 47D are provided at positions opposite to the dummy electrodes 38D and are bonded to the dummy electrodes 38D provided at the opposite positions. This makes it possible to improve the strength of the peripheral region R2.

[0092] The conductive film 51 is provided from the OPB region to the hole H1 in the peripheral region R2. The conductive film 51 contacts the n-type semiconductor layer 24 at the opening 25H of the anti-reflection film 25 provided in the OPB region, and contacts the wiring 46 of the drive substrate 200 through the hole H1. This allows a voltage to be supplied from the drive substrate 200 to the n-type semiconductor layer 24 through the conductive film 51. The conductive film 51 functions as a voltage supply path to the n-type semiconductor layer 24 and also functions as a light-shielding film, forming the OPB region. The conductive film 51 is made of a metal material including, for example, tungsten (W), aluminum (Al), titanium (Ti), molybdenum (Mo), tantalum (Ta), or copper (Cu). A passivation film 52 may be provided on the conductive film 51.

[0093] <3. Second embodiment> FIG. 27 shows an example of a schematic configuration of an imaging device 3 equipped with an imaging element 1 (hereinafter referred to as "imaging element 1a") relating to the above embodiment, variant B, variant E, and variant H.

[0094] The imaging device 3 is, for example, an electronic device such as an imaging device such as a digital still camera or a video camera, or a mobile terminal device such as a smartphone or a tablet terminal. The imaging device 3 includes, for example, an imaging element 1a, an optical system 141, a shutter device 142, a DSP circuit 143, a frame memory 144, a display unit 145, a storage unit 146, an operation unit 147, and a power supply unit 148. In the imaging device 3, the imaging element 1a, the shutter device 142, the DSP circuit 143, the frame memory 144, the display unit 145, the storage unit 146, the operation unit 147, and the power supply unit 148 are connected to each other via a bus line 149.

[0095] The imaging element 1a outputs image data (digital values) according to incident light. The optical system 141 is configured with one or more lenses, and guides light (incident light) from a subject to the imaging element 1a, forming an image on the light receiving surface of the imaging element 1a. The shutter device 142 is disposed between the optical system 141 and the imaging element 1a, and controls the light irradiation period and light blocking period of the imaging element 1a. The DSP circuit 143 is a signal processing circuit that processes image data (digital values) output from the imaging element 1a. The frame memory 144 temporarily holds the image data processed by the DSP circuit 143 on a frame-by-frame basis. The display unit 145 is, for example, a panel-type display device such as a liquid crystal panel or an organic EL (Electro Luminescence) panel, and displays a moving image or a still image captured by the imaging element 1a. The storage unit 146 records the image data of the moving image or the still image captured by the imaging element 1a in a recording medium such as a semiconductor memory or a hard disk. The operation unit 147, in accordance with an operation by a user, issues operation commands for various functions of the imaging device 3. The power supply unit 148 appropriately supplies various types of power to these power sources as operating power sources for the imaging element 1a, the shutter device 142, the DSP circuit 143, the frame memory 144, the display unit 145, the storage unit 146, and the operation unit 147.

[0096] Next, an example of an imaging procedure in the imaging device 3 will be described.

[0097] FIG. 28 shows an example of a flowchart of the imaging operation in the imaging device 3. The user issues an instruction to start imaging by operating the operation unit 147 (step S401). Then, the operation unit 147 transmits an imaging command to the imaging element 1a (step S402). In the imaging device 3, upon receiving the imaging command, the imaging element 1a performs various settings (e.g., the image quality adjustment described above) (step S403). Thereafter, the imaging element 1a performs imaging in a predetermined imaging method (step S404). Note that in the imaging device 3, the imaging element 1a repeatedly executes steps S403 and S404 as necessary.

[0098] The imaging element 1a outputs image data obtained by imaging to the DSP circuit 143. Here, the image data refers to data for all pixels of pixel signals generated based on charges temporarily stored in the floating diffusion FD. The DSP circuit 143 performs predetermined signal processing (e.g., noise reduction processing, etc.) based on the image data input from the imaging element 1a (step S405). The DSP circuit 143 stores the image data that has been subjected to the predetermined signal processing in the frame memory 144, and the frame memory 144 stores the image data in the storage unit 146 (step S406). In this manner, imaging is performed in the imaging device 3.

[0099] In this embodiment, the imaging element 1a is applied to the imaging device 3. This makes it possible to automatically adjust the image quality of the imaging element 1a.

[0100] <4. Modification of the Second Embodiment> In the second embodiment, the imaging device 3 may include an imaging device 1 (hereinafter referred to as "imaging device 1b") according to Modification A, Modification C, Modification D, Modification F, Modification G, or Modification H instead of the imaging device 1a. In this case, the imaging device 3 may include an image quality control circuit 2, as shown in Fig. 29, for example. Even in this case, image quality adjustment of the imaging device 1b can be automatically performed, as in the above application example.

[0101] <5. Application Examples> [Application example 1] The technology according to the present disclosure (the present technology) can be applied to various products. For example, the technology according to the present disclosure may be realized as a device mounted on any type of moving body such as an automobile, an electric vehicle, a hybrid electric vehicle, a motorcycle, a bicycle, a personal mobility device, an airplane, a drone, a ship, a robot, etc.

[0102] FIG. 30 is a block diagram showing a schematic configuration example of a vehicle control system, which is an example of a moving object control system to which the technology according to the present disclosure can be applied.

[0103] The vehicle control system 12000 includes a plurality of electronic control units connected via a communication network 12001. In the example shown in Fig. 30, the vehicle control system 12000 includes a drive system control unit 12010, a body system control unit 12020, an outside-vehicle information detection unit 12030, an inside-vehicle information detection unit 12040, and an integrated control unit 12050. Also, as functional configurations of the integrated control unit 12050, a microcomputer 12051, an audio / video output unit 12052, and an in-vehicle network I / F (interface) 12053 are illustrated.

[0104] The drivetrain control unit 12010 controls the operation of devices related to the drivetrain of the vehicle in accordance with various programs. For example, the drivetrain control unit 12010 functions as a control device for a drive force generating device for generating a drive force of the vehicle, such as an internal combustion engine or a drive motor, a drive force transmission mechanism for transmitting the drive force to the wheels, a steering mechanism for adjusting the steering angle of the vehicle, and a braking device for generating a braking force of the vehicle.

[0105] The body system control unit 12020 controls the operation of various devices mounted on the vehicle body according to various programs. For example, the body system control unit 12020 functions as a control device for a keyless entry system, a smart key system, a power window device, or various lamps such as head lamps, back lamps, brake lamps, turn signals, and fog lamps. In this case, radio waves or signals of various switches transmitted from a portable device that replaces a key may be input to the body system control unit 12020. The body system control unit 12020 receives the input of these radio waves or signals and controls the door lock device, power window device, lamps, and the like of the vehicle.

[0106] The outside-vehicle information detection unit 12030 detects information outside the vehicle equipped with the vehicle control system 12000. For example, an imaging unit 12031 is connected to the outside-vehicle information detection unit 12030. The outside-vehicle information detection unit 12030 causes the imaging unit 12031 to capture an image outside the vehicle and receives the captured image. The outside-vehicle information detection unit 12030 may perform object detection processing or distance detection processing for a person, a car, an obstacle, a sign, or characters on a road surface, based on the received image.

[0107] The imaging unit 12031 is an optical sensor that receives light and outputs an electrical signal according to the amount of light received. The imaging unit 12031 can output the electrical signal as an image, or as distance measurement information. The light received by the imaging unit 12031 may be visible light or invisible light such as infrared light.

[0108] The in-vehicle information detection unit 12040 detects information inside the vehicle. For example, a driver state detection unit 12041 that detects the state of the driver is connected to the in-vehicle information detection unit 12040. The driver state detection unit 12041 includes, for example, a camera that captures an image of the driver, and the in-vehicle information detection unit 12040 may calculate the degree of fatigue or concentration of the driver based on the detection information input from the driver state detection unit 12041, or may determine whether the driver is dozing.

[0109] The microcomputer 12051 can calculate control target values ​​for the driving force generating device, the steering mechanism, or the braking device based on the information inside and outside the vehicle acquired by the outside-of-vehicle information detection unit 12030 or the inside-vehicle information detection unit 12040, and output a control command to the drive system control unit 12010. For example, the microcomputer 12051 can perform cooperative control aimed at realizing the functions of an ADAS (Advanced Driver Assistance System), including vehicle collision avoidance or impact mitigation, following driving based on the inter-vehicle distance, vehicle speed maintenance driving, vehicle collision warning, vehicle lane departure warning, etc.

[0110] In addition, the microcomputer 12051 can perform cooperative control for the purpose of autonomous driving, which allows the vehicle to travel autonomously without relying on the driver's operation, by controlling the driving force generating device, steering mechanism, braking device, etc. based on information about the surroundings of the vehicle acquired by the outside vehicle information detection unit 12030 or the inside vehicle information detection unit 12040.

[0111] Furthermore, the microcomputer 12051 can output a control command to the body system control unit 12020 based on the information outside the vehicle acquired by the outside-vehicle information detection unit 12030. For example, the microcomputer 12051 can control the headlamps according to the position of a preceding vehicle or an oncoming vehicle detected by the outside-vehicle information detection unit 12030, and perform cooperative control for the purpose of preventing glare, such as switching from high beams to low beams.

[0112] The audio / image output unit 12052 transmits at least one output signal of audio and image to an output device capable of visually or audibly notifying information to passengers in the vehicle or the outside of the vehicle. In the example of Fig. 30, an audio speaker 12061, a display unit 12062, and an instrument panel 12063 are exemplified as the output device. The display unit 12062 may include at least one of an on-board display and a head-up display, for example.

[0113] FIG. 31 is a diagram showing an example of the installation position of the imaging unit 12031.

[0114] In FIG. 31, a vehicle 12100 has imaging units 12101, 12102, 12103, 12104, and 12105 as an imaging unit 12031.

[0115] The imaging units 12101, 12102, 12103, 12104, and 12105 are provided at positions such as the front nose, side mirrors, rear bumper, back door, and the upper part of the windshield inside the vehicle cabin of the vehicle 12100. The imaging unit 12101 provided at the front nose and the imaging unit 12105 provided at the upper part of the windshield inside the vehicle cabin mainly acquire images of the front of the vehicle 12100. The imaging units 12102 and 12103 provided at the side mirrors mainly acquire images of the sides of the vehicle 12100. The imaging unit 12104 provided at the rear bumper or back door mainly acquires images of the rear of the vehicle 12100. The images of the front acquired by the imaging units 12101 and 12105 are mainly used to detect a preceding vehicle, a pedestrian, an obstacle, a traffic light, a traffic sign, a lane, or the like.

[0116] 31 shows an example of the imaging ranges of the imaging units 12101 to 12104. Imaging range 12111 indicates the imaging range of the imaging unit 12101 provided on the front nose, imaging ranges 12112 and 12113 indicate the imaging ranges of the imaging units 12102 and 12103 provided on the side mirrors, respectively, and imaging range 12114 indicates the imaging range of the imaging unit 12104 provided on the rear bumper or back door. For example, an overhead image of the vehicle 12100 viewed from above is obtained by superimposing the image data captured by the imaging units 12101 to 12104.

[0117] At least one of the imaging units 12101 to 12104 may have a function of acquiring distance information. For example, at least one of the imaging units 12101 to 12104 may be a stereo camera made up of a plurality of imaging elements, or may be an imaging element having pixels for detecting a phase difference.

[0118] For example, the microcomputer 12051 can extract, as a preceding vehicle, a three-dimensional object that is the closest three-dimensional object on the travel path of the vehicle 12100 and travels at a predetermined speed (for example, 0 km / h or more) in approximately the same direction as the vehicle 12100, by calculating the distance to each three-dimensional object in the imaging ranges 12111 to 12114 and the change over time of this distance (relative speed with respect to the vehicle 12100) based on the distance information obtained from the imaging units 12101 to 12104. Furthermore, the microcomputer 12051 can set a vehicle distance to be secured in advance in front of the preceding vehicle, and perform automatic brake control (including follow-up stop control) and automatic acceleration control (including follow-up start control). In this way, cooperative control can be performed for the purpose of automatic driving that travels autonomously without relying on the driver's operation.

[0119] For example, the microcomputer 12051 classifies and extracts three-dimensional object data on three-dimensional objects into two-wheeled vehicles, ordinary vehicles, large vehicles, pedestrians, utility poles, and other three-dimensional objects based on distance information obtained from the imaging units 12101 to 12104, and can use the data for automatic obstacle avoidance. For example, the microcomputer 12051 distinguishes obstacles around the vehicle 12100 into obstacles that are visible to the driver of the vehicle 12100 and obstacles that are difficult to see. Then, the microcomputer 12051 determines a collision risk indicating the risk of collision with each obstacle, and when the collision risk is equal to or greater than a set value and a collision is possible, the microcomputer 12051 can provide driving assistance for collision avoidance by outputting an alarm to the driver via the audio speaker 12061 or the display unit 12062, or by performing forced deceleration or avoidance steering via the drive system control unit 12010.

[0120] At least one of the imaging units 12101 to 12104 may be an infrared camera that detects infrared rays. For example, the microcomputer 12051 can recognize a pedestrian by determining whether or not a pedestrian is present in the captured images of the imaging units 12101 to 12104. The recognition of such a pedestrian is performed, for example, by a procedure of extracting feature points in the captured images of the imaging units 12101 to 12104 as infrared cameras, and a procedure of performing pattern matching processing on a series of feature points that indicate the contour of an object to determine whether or not the object is a pedestrian. When the microcomputer 12051 determines that a pedestrian is present in the captured images of the imaging units 12101 to 12104 and recognizes the pedestrian, the audio / image output unit 12052 controls the display unit 12062 to superimpose a rectangular contour line for emphasis on the recognized pedestrian. The audio / image output unit 12052 may also control the display unit 12062 to display an icon or the like indicating a pedestrian at a desired position.

[0121] An example of a mobile object control system to which the technology according to the present disclosure can be applied has been described above. The technology according to the present disclosure can be applied to the imaging unit 12031 of the above-described configuration. Specifically, the imaging device 3 can be applied to the imaging unit 12031. By applying the technology according to the present disclosure to the imaging unit 12031, a high-quality captured image can be obtained, and therefore, high-precision control using the captured image can be performed in the mobile object control system.

[0122] [Application example 2] FIG. 32 is a diagram showing an example of a schematic configuration of an endoscopic surgery system to which the technology according to the present disclosure (the present technology) can be applied.

[0123] 32 shows a state in which an operator (doctor) 11131 is performing surgery on a patient 11132 on a patient bed 11133 using an endoscopic surgery system 11000. As shown in the figure, the endoscopic surgery system 11000 is composed of an endoscope 11100, other surgical tools 11110 such as an insufflation tube 11111 and an energy treatment tool 11112, a support arm device 11120 that supports the endoscope 11100, and a cart 11200 on which various devices for endoscopic surgery are mounted.

[0124] The endoscope 11100 is composed of a lens barrel 11101, a region of a predetermined length from the tip of which is inserted into a body cavity of a patient 11132, and a camera head 11102 connected to the base end of the lens barrel 11101. In the illustrated example, the endoscope 11100 is configured as a so-called rigid scope having a rigid lens barrel 11101, but the endoscope 11100 may be configured as a so-called flexible scope having a flexible lens barrel.

[0125] An opening into which an objective lens is fitted is provided at the tip of the lens barrel 11101. A light source device 11203 is connected to the endoscope 11100, and light generated by the light source device 11203 is guided to the tip of the lens barrel by a light guide extending inside the lens barrel 11101, and is irradiated via the objective lens toward an observation target in the body cavity of the patient 11132. The endoscope 11100 may be a direct-viewing endoscope, an oblique-viewing endoscope, or a side-viewing endoscope.

[0126] An optical system and an image sensor are provided inside the camera head 11102, and reflected light (observation light) from an observation target is collected on the image sensor by the optical system. The observation light is photoelectrically converted by the image sensor to generate an electrical signal corresponding to the observation light, i.e., an image signal corresponding to an observation image. The image signal is transmitted to a camera control unit (CCU) 11201 as RAW data.

[0127] The CCU 11201 is configured with a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), etc., and performs overall control of the operations of the endoscope 11100 and the display device 11202. Furthermore, the CCU 11201 receives an image signal from the camera head 11102, and performs various types of image processing on the image signal, such as development processing (demosaic processing), for displaying an image based on the image signal.

[0128] Under the control of the CCU 11201, the display device 11202 displays an image based on an image signal that has been subjected to image processing by the CCU 11201.

[0129] The light source device 11203 is composed of a light source such as an LED (Light Emitting Diode), and supplies the endoscope 11100 with irradiation light when photographing an operation site or the like.

[0130] The input device 11204 is an input interface for the endoscopic surgery system 11000. A user can input various information and instructions to the endoscopic surgery system 11000 via the input device 11204. For example, the user inputs an instruction to change the imaging conditions (type of irradiated light, magnification, focal length, etc.) of the endoscope 11100.

[0131] The treatment tool control device 11205 controls the driving of the energy treatment tool 11112 for cauterizing tissue, incising, sealing blood vessels, etc. The insufflation device 11206 sends gas into the body cavity of the patient 11132 via the insufflation tube 11111 to inflate the body cavity for the purpose of securing the field of view of the endoscope 11100 and securing the working space of the surgeon. The recorder 11207 is a device capable of recording various information related to the surgery. The printer 11208 is a device capable of printing various information related to the surgery in various formats such as text, image, or graph.

[0132] The light source device 11203 that supplies irradiation light to the endoscope 11100 when photographing the surgical site can be composed of a white light source composed of, for example, an LED, a laser light source, or a combination of these. When the white light source is composed of a combination of RGB laser light sources, the output intensity and output timing of each color (each wavelength) can be controlled with high precision, so that the white balance of the captured image can be adjusted in the light source device 11203. In this case, it is also possible to capture images corresponding to each of the RGB colors in a time-division manner by irradiating the observation object with laser light from each of the RGB laser light sources in a time-division manner and controlling the driving of the image sensor of the camera head 11102 in synchronization with the irradiation timing. According to this method, a color image can be obtained without providing a color filter to the image sensor.

[0133] The light source device 11203 may be controlled to change the intensity of the light it outputs at predetermined time intervals. The driving of the image sensor of the camera head 11102 may be controlled in synchronization with the timing of the change in the light intensity to obtain images in a time-division manner, and the images may be synthesized to generate an image with a high dynamic range that is free of so-called blackout and whiteout.

[0134] The light source device 11203 may be configured to supply light of a predetermined wavelength band corresponding to the special light observation. In the special light observation, for example, by utilizing the wavelength dependency of light absorption in body tissue, a narrow band light is irradiated compared to the irradiated light (i.e., white light) during normal observation, and a predetermined tissue such as blood vessels on the mucous membrane surface is photographed with high contrast, so-called narrow band imaging is performed. Alternatively, in the special light observation, a fluorescent observation may be performed in which an image is obtained by fluorescence generated by irradiating an excitation light. In the fluorescent observation, it is possible to irradiate an excitation light to a body tissue and observe the fluorescence from the body tissue (autofluorescence observation), or to locally inject a reagent such as indocyanine green (ICG) into the body tissue and irradiate the body tissue with excitation light corresponding to the fluorescent wavelength of the reagent to obtain a fluorescent image. The light source device 11203 may be configured to supply narrow band light and / or excitation light corresponding to such special light observation.

[0135] FIG. 33 is a block diagram showing an example of the functional configuration of the camera head 11102 and the CCU 11201 shown in FIG.

[0136] The camera head 11102 has a lens unit 11401, an imaging unit 11402, a drive unit 11403, a communication unit 11404, and a camera head control unit 11405. The CCU 11201 has a communication unit 11411, an image processing unit 11412, and a control unit 11413. The camera head 11102 and the CCU 11201 are connected to each other by a transmission cable 11400 so as to be able to communicate with each other.

[0137] The lens unit 11401 is an optical system provided at the connection portion with the lens barrel 11101. Observation light taken in from the tip of the lens barrel 11101 is guided to the camera head 11102 and enters the lens unit 11401. The lens unit 11401 is configured by combining a plurality of lenses including a zoom lens and a focus lens.

[0138] The imaging unit 11402 is composed of an imaging element. The imaging element constituting the imaging unit 11402 may be one (so-called single-plate type) or multiple (so-called multi-plate type). When the imaging unit 11402 is composed of a multi-plate type, for example, each imaging element may generate an image signal corresponding to each of RGB, and a color image may be obtained by combining the image signals. Alternatively, the imaging unit 11402 may be configured to have a pair of imaging elements for acquiring image signals for the right eye and the left eye corresponding to 3D (Dimensional) display. By performing 3D display, the surgeon 11131 can more accurately grasp the depth of the biological tissue in the surgical site. Note that when the imaging unit 11402 is composed of a multi-plate type, multiple lens units 11401 may be provided corresponding to each imaging element.

[0139] Furthermore, the imaging unit 11402 does not necessarily have to be provided in the camera head 11102. For example, the imaging unit 11402 may be provided inside the lens barrel 11101, immediately behind the objective lens.

[0140] The driving unit 11403 is configured by an actuator, and moves the zoom lens and focus lens of the lens unit 11401 by a predetermined distance along the optical axis under the control of the camera head control unit 11405. This allows the magnification and focus of the image captured by the imaging unit 11402 to be appropriately adjusted.

[0141] The communication unit 11404 is configured by a communication device for transmitting and receiving various information to and from the CCU 11201. The communication unit 11404 transmits the image signal obtained from the imaging unit 11402 to the CCU 11201 via the transmission cable 11400 as RAW data.

[0142] Furthermore, the communication unit 11404 receives a control signal for controlling the driving of the camera head 11102 from the CCU 11201, and supplies the control signal to the camera head control unit 11405. The control signal includes information on the imaging conditions, such as information specifying the frame rate of the captured image, information specifying the exposure value at the time of capturing the image, and / or information specifying the magnification and focus of the captured image.

[0143] The image capturing conditions such as the frame rate, exposure value, magnification, and focus may be appropriately specified by a user, or may be automatically set by the control unit 11413 of the CCU 11201 based on an acquired image signal. In the latter case, the endoscope 11100 is equipped with a so-called AE (Auto Exposure) function, AF (Auto Focus) function, and AWB (Auto White Balance) function.

[0144] The camera head control unit 11405 controls the driving of the camera head 11102 based on a control signal received from the CCU 11201 via the communication unit 11404.

[0145] The communication unit 11411 is configured with a communication device for transmitting and receiving various information to and from the camera head 11102. The communication unit 11411 receives an image signal transmitted from the camera head 11102 via the transmission cable 11400.

[0146] Furthermore, the communication unit 11411 transmits, to the camera head 11102, a control signal for controlling the driving of the camera head 11102. The image signal and the control signal can be transmitted by electrical communication, optical communication, or the like.

[0147] The image processing unit 11412 performs various types of image processing on the image signal, which is RAW data sent from the camera head 11102 .

[0148] The control unit 11413 performs various controls related to imaging of the surgical site etc. by the endoscope 11100 and display of the captured image obtained by imaging the surgical site etc. For example, the control unit 11413 generates a control signal for controlling the driving of the camera head 11102.

[0149] Further, the control unit 11413 causes the display device 11202 to display the captured image showing the surgical site, etc., based on the image signal that has been image-processed by the image processing unit 11412. At this time, the control unit 11413 may recognize various objects in the captured image using various image recognition techniques. For example, the control unit 11413 can recognize surgical tools such as forceps, specific living body parts, bleeding, mist when the energy treatment tool 11112 is used, etc., by detecting the shape and color of the edge of an object included in the captured image. When the control unit 11413 causes the display device 11202 to display the captured image, it may use the recognition result to superimpose various types of surgery support information on the image of the surgical site. By superimposing and presenting the surgery support information to the surgeon 11131, the burden on the surgeon 11131 can be reduced and the surgeon 11131 can proceed with the surgery reliably.

[0150] The transmission cable 11400 connecting the camera head 11102 and the CCU 11201 is an electrical signal cable for communication of electrical signals, an optical fiber for optical communication, or a composite cable of these.

[0151] Here, in the illustrated example, communication is performed wired using a transmission cable 11400, but communication between the camera head 11102 and the CCU 11201 may also be performed wirelessly.

[0152] An example of an endoscopic surgery system to which the technology according to the present disclosure can be applied has been described above. Of the configurations described above, the technology according to the present disclosure can be suitably applied to the imaging unit 11402 provided in the camera head 11102 of the endoscope 11100. By applying the technology according to the present disclosure to the imaging unit 11402, a high-quality captured image can be obtained, and therefore, a high-quality endoscope 11100 can be provided.

[0153] The present disclosure has been described above by giving embodiments and their modified examples, application examples, and application examples, but the present disclosure is not limited to the embodiments, etc., and various modifications are possible. Note that the effects described in this specification are merely examples. The effects of the present disclosure are not limited to the effects described in this specification. The present disclosure may have effects other than the effects described in this specification.

[0154] Furthermore, for example, the present disclosure can have the following configuration. (1) A plurality of sensor pixels each including a photoelectric conversion unit and a readout circuit that outputs a pixel signal based on the charge output from the photoelectric conversion unit; a voltage control unit that applies a control voltage based on the pixel signal to each of the photoelectric conversion units; An imaging element comprising: (2) The voltage control unit relatively increases the control voltage when the pixel signal exceeds a first threshold, and relatively decreases the control voltage when the pixel signal falls below a second threshold that is smaller than the first threshold. The imaging element according to (1). (3) Each of the sensor pixels further includes a first electrode and a second electrode sandwiching the photoelectric conversion unit therebetween, The voltage control unit generates the first voltage and the second voltage based on the pixel signal such that a potential difference between a first voltage applied to the first electrode and a second voltage applied to the second electrode becomes the control voltage. An imaging element according to (1) or (2). (4) Each of the sensor pixels includes: a charge holding unit that holds the charges transferred from the photoelectric conversion unit; a transfer transistor electrically connected to the second electrode and configured to transfer charges from the photoelectric conversion unit to the charge storage unit; a drain transistor electrically connected to the second electrode and configured to initialize charges in the photoelectric conversion unit; Further comprising: The voltage control unit applies the second voltage to the second electrode when the discharge transistor is on. The imaging element according to (3). (5) Each of the pixels is a first electrode and a second electrode sandwiching the photoelectric conversion unit; a charge holding unit that holds the charges transferred from the photoelectric conversion unit; a transfer transistor electrically connected to the second electrode and configured to transfer charges from the photoelectric conversion unit to the charge storage unit; Further comprising: the read circuit has a reset transistor that initializes a potential of the charge holding unit; The voltage control unit generates the first voltage based on the pixel signal so that a potential difference between a first voltage applied to the first electrode and a second voltage applied to the second electrode by the reset transistor when the transfer transistor is on becomes the control voltage. An imaging element according to (1) or (2). (6) Each of the pixels further includes a charge holding unit that holds the charge transferred from the photoelectric conversion unit, the read circuit has a reset transistor that initializes a potential of the charge holding unit; The voltage control unit generates the first voltage based on the pixel signal such that a potential difference between a first voltage applied to the first electrode and a second voltage applied to the second electrode by the reset transistor becomes the control voltage. An imaging element according to (1) or (2). (7) an AD (Analog-to-Digital) conversion circuit for converting the pixel signal; a range control unit that outputs a range setting value based on the pixel signal to the AD conversion circuit; Further equipped An imaging element according to any one of (1) to (6). (8) The range control unit relatively increases the range setting value when the pixel signal exceeds a first threshold value, and relatively decreases the range setting value when the pixel signal falls below a second threshold value that is smaller than the first threshold value. The imaging element according to (7). (9) Each of the sensor pixels includes: a charge holding unit that holds the charges transferred from the photoelectric conversion unit; a transfer transistor that transfers charges from the photoelectric conversion unit to the charge storage unit; A switch element connected to the charge storage unit; an auxiliary capacitance connected in parallel to the capacitance of the charge holding unit via the switch element; a conversion efficiency control unit that controls on / off of the switch element based on the pixel signal; Further equipped An imaging element according to any one of (1) to (6). (10) The conversion efficiency control unit turns off the switch element when the pixel signal exceeds a first threshold, and turns on the switch element when the pixel signal falls below a second threshold that is smaller than the first threshold. The imaging element according to (9). (11) an image sensor having a plurality of sensor pixels, each of which includes a photoelectric conversion unit and a readout circuit that outputs a pixel signal based on the charge output from the photoelectric conversion unit; an image quality control circuit that applies a control voltage based on the pixel signal to each of the photoelectric conversion units; Equipped with Imaging device.

[0155] According to an embodiment of the imaging element and imaging device of the present disclosure, a control voltage based on a pixel signal is applied to each photoelectric conversion unit, so that image quality adjustment can be performed according to the luminance of image data, compared to a case where a fixed voltage is applied to each photoelectric conversion unit. Therefore, deterioration of image quality can be suppressed. Note that the effects of the present disclosure are not necessarily limited to the effects described herein, and may be any of the effects described in this specification.

[0156] This application claims priority based on Japanese Patent Application No. 2019-043786, filed on March 11, 2019 in the Japan Patent Office, the entire contents of which are incorporated herein by reference.

[0157] Those skilled in the art will recognize that various modifications, combinations, subcombinations, and variations may occur to those skilled in the art depending on design requirements and other factors, and that such modifications are within the scope of the appended claims and their equivalents.

Claims

1. A plurality of sensor pixels each including a photoelectric conversion unit and a readout circuit that outputs a pixel signal based on the charge output from the photoelectric conversion unit; a voltage control unit that applies a control voltage based on the pixel signal to each of the photoelectric conversion units; Conversion efficiency control section Equipped with Each of the sensor pixels includes: a charge holding unit that holds the charges transferred from the photoelectric conversion unit; a transfer transistor that transfers charges from the photoelectric conversion unit to the charge storage unit; A switch element connected to the charge storage unit; an auxiliary capacitance connected in parallel to the capacitance of the charge holding unit via the switch element; Further comprising: the conversion efficiency control unit controls the on / off of the switch element based on the pixel signal; The conversion efficiency control unit turns off the switch element when the pixel signal exceeds a first threshold, and turns on the switch element when the pixel signal falls below a second threshold that is smaller than the first threshold. Image sensor.

2. The voltage control unit increases the control voltage when the pixel signal exceeds the first threshold value relatively to the control voltage when the pixel signal falls below the second threshold value, and decreases the control voltage when the pixel signal falls below the second threshold value relatively to the control voltage when the pixel signal exceeds the first threshold value. The imaging device according to claim 1 .

3. Each of the sensor pixels further includes a first electrode and a second electrode sandwiching the photoelectric conversion unit, The voltage control unit generates the first voltage and the second voltage based on the pixel signal such that a potential difference between a first voltage applied to the first electrode and a second voltage applied to the second electrode becomes the control voltage. The imaging device according to claim 1 .

4. Each of the sensor pixels further includes a discharge transistor that initializes a charge of the photoelectric conversion unit, the transfer transistor is electrically connected to the second electrode; the emission transistor is electrically connected to the second electrode; The voltage control unit applies the second voltage to the second electrode when the discharge transistor is on. The imaging device according to claim 3 .

5. Each of the sensor pixels further includes a first electrode and a second electrode sandwiching the photoelectric conversion unit, the transfer transistor is electrically connected to the second electrode; the read circuit has a reset transistor that initializes a potential of the charge holding unit; The voltage control unit generates the first voltage based on the pixel signal so that a potential difference between a first voltage applied to the first electrode and a second voltage applied to the second electrode by the reset transistor when the transfer transistor is on becomes the control voltage. The imaging device according to claim 1 .

6. Each of the sensor pixels further includes a first electrode and a second electrode sandwiching the photoelectric conversion unit, the read circuit has a reset transistor that initializes a potential of the charge holding unit; The voltage control unit generates the first voltage based on the pixel signal such that a potential difference between a first voltage applied to the first electrode and a second voltage applied to the second electrode by the reset transistor becomes the control voltage. The imaging device according to claim 1 .

7. an image sensor having a plurality of sensor pixels, each of which includes a photoelectric conversion unit and a readout circuit that outputs a pixel signal based on the charge output from the photoelectric conversion unit; an image quality control circuit that applies a control voltage based on the pixel signal to each of the photoelectric conversion units; Equipped with Each of the sensor pixels includes: a charge holding unit that holds the charges transferred from the photoelectric conversion unit; a transfer transistor that transfers charges from the photoelectric conversion unit to the charge storage unit; A switch element connected to the charge storage unit; an auxiliary capacitance connected in parallel to the capacitance of the charge storage unit via the switch element; a conversion efficiency control unit that controls on / off of the switch element based on the pixel signal; Further comprising: The conversion efficiency control unit turns off the switch element when the pixel signal exceeds a first threshold, and turns on the switch element when the pixel signal falls below a second threshold that is smaller than the first threshold. Imaging device.

Citation Information

Patent Citations

  • Imaging apparatus and control method therefor

    JP2016134909A

  • Imaging apparatus, driving method for imaging apparatus, and imaging system

    JP2018098690A

  • Solid-state imaging element

    WO2017150167A1