Image sensor and electronic device
By allocating charge storage devices on two substrates of the image sensor, the problem of excessive charge storage area in ITOF technology is solved, the circuit scale and ranging accuracy of the sensor are improved, and the cost and data processing pressure are reduced.
Patent Information
- Application Number
- CN202010597663.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-06-28
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2040-06-28
AI Technical Summary
In image sensors, the indirect time-of-flight ranging method (ITOF) technology requires a large number of charge storage devices, which occupies too much chip layout area, affecting the circuit scale and cost.
By distributing the charge storage device on two substrates, using the combined design of the first substrate and the second substrate, the transmission device and processing circuit are respectively arranged to realize layered storage and processing of charge, and the charge storage device occupation is avoided on a single substrate The phenomenon of excessive area.
It improves the circuit area and resolution of the image sensor, reduces costs, enhances dynamic range and ranging accuracy, and reduces data processing pressure.
Smart Images

Figure CN113852771B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of image sensors, and in particular to an image sensor and an electronic device. Background Art
[0002] The principle of time of flight (TOF) is to continuously send light pulses to the target, then use a sensor to receive the light returned from the object, and obtain the distance of the target by detecting the flight (round-trip) time of the light pulses.
[0003] As a type of TOF, indirect time of flight (ITOF) technology actively illuminates the object to be measured, and determines the distance information of the object to be measured by measuring the delay of the round-trip time, that is, the delay information is converted into distance information using the ITOF ranging equation. In this ranging equation, several different phase information of the reflected signal are generally involved, that is, the distance of the target object is determined based on the phase information. The phase information is generally first converted into an electrical signal by a photoelectric conversion device in the sensor, and the electrical signal needs to be stored in a charge storage device. Unlike non-ranging image sensors, the charge storage device requires a large capacity. In the sensor, due to the limited layout area of the chip, too many charge storage devices will consume too much chip area, resulting in a reduction in the remaining area and a reduction in the circuit scale. Summary of the invention
[0004] The purpose of this application is to provide an image sensor and an electronic device to address the deficiencies in the above-mentioned prior art. The technical solutions adopted in the embodiments of this application are as follows:
[0005] In a first aspect, an embodiment of the present application provides an image sensor, comprising: a first substrate, comprising a pixel array, the pixel array being composed of pixel units, the pixel units comprising: a photoelectric conversion device, a transmission device and a first charge storage device, the photoelectric conversion device being used to receive a light signal and generate photogenerated electrons, the transmission device being used to control the transmission of the photogenerated electrons, and the charge storage device being used to store the photogenerated electrons transmitted by the transmission device; a second substrate, comprising a second charge storage device and a processing circuit, the processing circuit being used to process the photogenerated electrons stored in the first charge storage device and the second charge device.
[0006] Optionally, the storage capacity of the second charge storage device is greater than the storage capacity of the first charge storage device.
[0007] Optionally, the pixel unit includes at least two of the transmission devices and at least two of the first charge storage devices.
[0008] Optionally, the processing circuit includes a reset device and a readout device, wherein the reset device is used to reset the second charge storage device, and the readout device is used to process and read out the photogenerated electrons in the charge storage device.
[0009] Optionally, the first substrate and the second substrate are distributed along a vertical direction, the first substrate and the second substrate are connected via a bonding conductor, and the first charge storage device and the second charge storage device are electrically connected via the bonding conductor.
[0010] In a second aspect, an embodiment of the present application provides an electronic device, comprising: a light source for emitting a light signal to a target object; an image sensor for receiving the light signal reflected by the target object and generating an electrical signal, wherein the image sensor comprises: a first substrate, comprising a pixel array, the pixel array being composed of pixel units, the pixel units comprising a photoelectric conversion device, a transmission device and a first charge storage device, the photoelectric conversion device being used to receive the light signal and generate photogenerated electrons, the transmission device being used to control the transmission of the photogenerated electrons, and the charge storage device being used to store the photogenerated electrons transmitted by the transmission device; a second substrate, comprising a second charge storage device and a processing circuit, the second charge storage device, the processing circuit being used to process the photogenerated electrons stored in the first charge storage device and the second charge device.
[0011] Optionally, the storage capacity of the second charge storage device is greater than the storage capacity of the first charge storage device.
[0012] Optionally, the pixel unit includes at least two of the transmission devices and at least two of the first charge storage devices.
[0013] Optionally, the processing circuit includes a reset device and a readout device, wherein the reset device is used to reset the second charge storage device, and the readout device is used to process and read out the photogenerated electrons in the charge storage device.
[0014] Optionally, the first substrate and the second substrate are distributed along a vertical direction, the first substrate and the second substrate are connected via a bonding conductor, and the first charge storage device and the second charge storage device are electrically connected via the bonding conductor.
[0015] The beneficial effects of this application are:
[0016] An image sensor provided by an embodiment of the present application includes: a first substrate including a pixel array, the pixel array is composed of pixel units, the pixel units include: a photoelectric conversion device, a transmission device and a first charge storage device, the photoelectric conversion device is used to receive a light signal and generate photogenerated electrons, the transmission device is used to control the transmission of the photogenerated electrons, and the charge storage device is used to store the photogenerated electrons transmitted by the transmission device; a second substrate including a second charge storage device and a processing circuit, the processing circuit is used to process the photogenerated electrons stored in the first charge storage device and the second charge device. In this way, the purpose of distributing the storage device on two substrates is achieved, so that the area of the sensor and its circuit can be increased to a certain extent, the scale of the circuit can be improved, and the cost of the substrate can be saved. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.
[0018] Figure 1 A schematic block diagram of ITOF ranging provided in an embodiment of the present application;
[0019] Figure 2 A module block diagram of a pixel unit in an image sensor provided in an embodiment of the present application;
[0020] Figure 3 A circuit and timing diagram of a pixel unit in an image sensor provided in an embodiment of the present application;
[0021] Figure 4 A circuit and timing diagram of a pixel unit in another image sensor provided in an embodiment of the present application;
[0022] Figure 5 A side view of another image sensor provided in an embodiment of the present application
[0023] Figure 6 A schematic diagram of another image sensor provided in an embodiment of the present application. DETAILED DESCRIPTION
[0024] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. The components of the embodiments of the present application described and shown in the drawings here can be arranged and designed in various different configurations.
[0025] Therefore, the following detailed description of the embodiments of the present application provided in the accompanying drawings is not intended to limit the scope of the present application for which protection is sought, but merely represents selected embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.
[0026] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, further definition and explanation thereof is not required in subsequent drawings.
[0027] In recent years, in order to make autonomous driving applicable in life, the research on 3D imaging systems has made great progress. There are several main requirements for imaging systems in autonomous driving: resistance to large background light (sunlight is the strongest 100klux), improved ranging accuracy and fast ranging. Therefore, a pixel circuit in the image sensor is required to reduce the waste of area in the pixel and complete part of the calculation when the circuit is working, so that the received signal can be more comprehensive, improve the ranging accuracy, reduce the pressure of post-stage data processing, save some data processing time, and quickly obtain the distance to the object.
[0028] Figure 1 It is a general TOF distance measurement principle diagram. The flight time between the sensor and the object to be measured is obtained by the phase difference between the emitted light signal and the echo signal, and then the distance information is calculated. As shown in the figure, a beam of emitted light signal is emitted from the light source 101. The emitted light signal can be a laser pulse signal modulated by a pseudo-random sequence or an ordinary laser pulse signal. After the emitted light signal is reflected by the object 102, it is focused on the pixel of the image sensor 104 by the lens 103. The signal received by the image sensor is the echo signal and the background light signal or only the background light signal, and it is assumed that the background light signal is uniform within a certain time. The pixel circuit in the image sensor 104 performs signal elimination or signal extraction on the received signal, removes the background light part, and obtains a pure echo signal. Finally, the phase shift of the echo signal relative to the emitted light signal in the returned light by each pixel can detect the distance of the surrounding objects.
[0029] In ITOF ranging, the image sensor 104 needs to receive the echo signal and perform phase modulation and processing on the signal, perform photoelectric conversion on the processed signal, and further store and process the generated electrical signal. Compared with the traditional 2D image sensor, the 3D image sensor needs to store more charge, and therefore has a greater capacity requirement for the charge storage device.
[0030] The following is combined Figure 2 An image sensor 200 provided in the present application includes: a first substrate 201 and a second substrate 202, the first substrate 201 includes a pixel array, the pixel array is composed of pixel units, the pixel units include: a photoelectric conversion device 210, a transmission device 211 and a transmission device 212, a charge storage device 213 and a charge storage device 215, the second substrate 202 includes a charge storage device 214 and a charge storage device 215, and other processing circuits (not shown in the figure), which are used to process the photogenerated electrons stored in the charge storage device 213, the charge storage device 214, the charge storage device 215 and the charge storage device 216.
[0031] The photoelectric conversion device 210 is used to receive light signals and generate photogenerated electrons, the transmission devices 211 and 212 are used to control the transmission of the photogenerated electrons generated in the photoelectric conversion device 210, and the charge storage devices 213 and 214, the charge storage devices 215 and 216 are used to store the photogenerated electrons generated by the photoelectric conversion device 210 transmitted by the transmission devices 211 and 212, respectively. That is, when the transmission device 211 is turned on, the charge in the photoelectric conversion device 210 is transferred to the charge storage devices 213 and 214 through the transmission device 211, and correspondingly, when the transmission device 212 is turned on, the charge in the photoelectric conversion device 210 is transferred to the charge storage devices 215 and 216 through the transmission device 212.
[0032] Compared with ITOF technology, the transmission device 211 and the transmission device 212 transmit photogenerated electrons at different phases respectively. For example, the transmission device 211 can transmit photogenerated electrons at a phase of 0°, and the transmission device 212 can transmit photogenerated electrons at a phase of 180°; alternatively, the transmission device 211 can transmit photogenerated electrons at a phase of 90°, and the transmission device 212 can transmit photogenerated electrons at a phase of 270°.
[0033] It can be seen that the charge storage device 213 and the charge storage device 214 jointly store the photogenerated electrons transmitted by the transmission device 211, and the charge storage device 215 and the charge storage device 216 jointly store the photogenerated electrons transmitted by the transmission device 212, and the charge storage device 213 and the charge storage device 214 are respectively arranged on the first substrate 201 and the second substrate 202, so the two substrates jointly provide a device for storing charges, avoiding the situation where the charge storage device occupies a large amount of substrate area when arranged on the first substrate, thereby reducing the available area of other circuits. In other words, by arranging the charge storage device on two substrates, the capacity of the charge storage device can be increased, thereby improving the dynamic range of the image sensor.
[0034] As an implementation, the storage capacity of the charge storage device 214 is greater than the storage capacity of the charge storage device 213, and the storage capacity of the charge storage device 216 is greater than the storage capacity of the charge storage device 215. In this way, the area occupied by the charge storage device 213 and the charge storage device 215 on the first substrate 201 can be further reduced, and more pixel units can be placed on the first substrate 201, thereby improving the resolution and dynamic range of the image processor.
[0035] As another embodiment, the first substrate 201 and the second substrate 202 are distributed along the vertical direction, the first substrate 201 and the second substrate 202 are connected by a bonding conductor (not shown in the figure), and the charge storage device 213 and the charge storage device 214 are electrically connected by a bonding conductor, and the charge storage device 2,5 and the charge storage device 216 are electrically connected by a bonding conductor.
[0036] As another embodiment, the processing circuit includes a reset device and a readout device. The reset device (not shown in the figure) is used to reset the charge storage device 213, the charge storage device 214, the charge storage device 215, and the charge storage device 216. The readout device (not shown in the figure) is used to process and read out the photogenerated electrons in the charge storage device 213, the charge storage device 214, the charge storage device 215, and the charge storage device 216.
[0037] Combine the following Figure 3 , taking the photoelectric conversion device as a photodiode, the transmission device as a transmission transistor, and the charge storage device as a capacitor as an example, an image sensor provided by an embodiment of the present application is described in detail.
[0038] The image sensor 300 includes: a first substrate 301, the substrate 301 includes a pixel array, the pixel array is composed of pixel units, the pixel unit includes: a photodiode 310, a transfer transistor 311 and a transfer transistor 312, a capacitor 313 and a capacitor 315, a second substrate 302, the substrate 302 includes a capacitor 314 and a capacitor 316, and a processing circuit (not shown in the figure), the processing circuit is used to process the photogenerated electrons stored in the capacitors 313, 314, 315, and 316.
[0039] The working principle of the image sensor 300 is as follows:
[0040] The photodiode 310 receives the light signal and generates photogenerated electrons. The transmission transistor 311 and the transmission transistor 312 control the transmission of the photogenerated electrons generated in the photodiode 310 through TX1 and TX2 respectively. The timing of TX1 and TX2 is as follows: Figure 3 As shown in , the two transfer transistors are turned on alternately to transfer the photogenerated electrons in the photodiode 310. Specifically, the transfer transistor 311 transfers the charge to the capacitor 313 and the capacitor 314, and the transfer transistor 312 transfers the charge to the capacitor 315 and the capacitor 316. The processing circuit (not shown in the figure) converts the charges stored in these capacitors into current or voltage signals for output.
[0041] As an implementation mode, the storage capacity of capacitor 314 is greater than the storage capacity of capacitor 313, and the storage capacity of capacitor 316 is greater than the storage capacity of capacitor 315. In this way, the area occupied by capacitors 313 and 315 on the first substrate 301 can be further reduced, and more pixel units can be placed on the first substrate 301, thereby improving the resolution and dynamic range of the image processor.
[0042] As another implementation, the processing circuit may further include a reset device and a readout device. In the following, the photoelectric conversion device is a photodiode, the transmission device is a transmission transistor, i.e., a transmission gate, the reset device is a reset transistor, and the readout device is a source follower (Source Follow, SF) as an example. Figure 4 The working process of the image sensor 400 provided in the present application is described in detail.
[0043] First, the reset transistors 413 and 414 are turned on, that is, the transistors 413 and 414 are connected to a high level, the charges on the capacitors 417 and 418 are reset, and the reset charges are read out, that is, the corresponding source follower 421 and the row selection switch 422 are turned on, and the reset current is read out; correspondingly, the reset transistors 415 and 416 are turned on, that is, the gates of the transistors 415 and 416 are connected to a high level, the charges on the capacitors 419 and 420 are reset, and the reset charges are read out, that is, the corresponding source follower 423 and the row selection switch 424 are turned on, and the reset current is read out.
[0044] It should be noted that the reset transistors 413, 414 and 415, 416 may be turned on at the same time, or the transistors 413, 414 may be turned on first, and then the transistors 415, 416 may be turned on.
[0045] Then, the reset transistors 413, 414, 415, and 416 are turned off, that is, the gates of these transistors are connected to a low level, the photodiode 410 receives the light signal and converts it into photogenerated electrons, and the gates of the transmission gates 411 and 412 are connected to the modulation signal, and the waveforms of the signals can be respectively as follows: Figure 4 As shown in TXA / PGA and TXB / PGB, they are used to demodulate optical signals at 0° and 180° phases.
[0046] Exemplarily, the transmission gate 411 transmits the photogenerated electrons with a phase of 0° to the capacitors 417 and 418 for storage, and the transmission gate 412 transmits the photogenerated electrons with a phase of 180° to the capacitors 419 and 420 for storage.
[0047] Optionally, the transmission gate 411 is turned on first, and the charge at the 0° phase in the photodiode 410 is transferred to the capacitor 417 and the capacitor 418 through the transmission gate 411, and the modulated charge at the 0° phase is read out, that is, the corresponding source follower 423 and the row selection switch 424 are turned on, and the modulated current at the 0° phase is read out; the transmission gate 412 is turned on again, and part of the charge in the photodiode 410 is transferred to the capacitor 419 and the capacitor 420 through the transmission gate 412, and the modulated charge at the 180° phase is read out, that is, the corresponding source follower 423 and the row selection switch 424 are turned on, and the modulated current at the 180° phase is read out.
[0048] A subsequent circuit (not shown in the figure) can process the twice read currents and the currents in the two phases to obtain the distance information, ie, the depth information, of the target object, and further obtain a 3D image of the target object.
[0049] Optional, such as Figure 5 In the image sensor 500 shown, the first substrate 501 and the second substrate 502 are connected via a bonding conductor 503 .
[0050] Accordingly, the present application also provides an electronic device, including a light source for emitting a light signal to a target object; an image sensor for receiving the light signal reflected by the target object and generating an electrical signal. For example, the image sensor 600 is as follows: Figure 6 As shown, it includes: a first substrate 601, including a pixel array composed of pixel units 603, the pixel unit 603 includes a photoelectric conversion device, a transmission device and a first charge storage device 604, the photoelectric conversion device is used to receive light signals and generate photogenerated electrons, the transmission device is used to control the transmission of photogenerated electrons, and the charge storage device is used to store the photogenerated electrons transmitted by the transmission device; a second substrate 602, including a second charge storage device 605 and a processing circuit 606, the processing circuit is used to process the photogenerated electrons stored in the first charge storage device and the second charge device.
[0051] Optionally, the image sensor further includes a driving circuit 607 for driving the readout of signals of the pixel circuit on the first substrate 601 .
[0052] The first charge storage device 604 and the second charge storage device 605 are respectively arranged on the first substrate 601 and the second substrate 602. Therefore, the two substrates jointly provide a device for storing charge, avoiding the situation where the charge storage device occupies a large amount of substrate area when arranged on the first substrate, thereby reducing the available area of other circuits. In other words, by arranging the charge storage device on two substrates, the capacity of the charge storage device can be increased, thereby improving the dynamic range of the image sensor.
[0053] Optionally, the storage capacity of the second charge storage device 605 is greater than the storage capacity of the first charge storage device 604 .
[0054] Therefore, the area occupied by the first charge storage device 604 on the first substrate 601 can be further reduced, so that more pixel units can be arranged on the substrate 601, thereby improving the dynamic range of the image sensor.
[0055] Optionally, the processing circuit 606 includes a reset device and a readout device, wherein the reset device is used to reset the second charge storage device, and the readout device is used to process and read out the photogenerated electrons in the charge storage device.
[0056] Optionally, the first substrate 601 and the second substrate 602 are distributed along the vertical direction, the first substrate 601 and the second substrate 602 are connected via a bonding conductor, and the first charge storage device 604 and the second charge storage device 605 are electrically connected via the bonding conductor.
[0057] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.
[0058] The above description is only the preferred embodiment of the present application, and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application. It should be noted that similar numbers and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings. The above description is only the preferred embodiment of the present application, and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.
Claims
1. An image sensor, comprising: The first substrate includes a pixel array, wherein the pixel array is composed of pixel units, and the pixel units include: A photoelectric conversion device, a transmission device and a first charge storage device, wherein the photoelectric conversion device is used to receive a light signal and generate photogenerated electrons, the transmission device is used to control the transmission of the photogenerated electrons, and the charge storage device is used to store the photogenerated electrons transmitted by the transmission device; a second substrate comprising a second charge storage device and a processing circuit, wherein the processing circuit is used to process the photogenerated electrons stored in the first charge storage device and the second charge device; The storage capacity of the second charge storage device is greater than the storage capacity of the first charge storage device; The pixel unit comprises at least two of the transmission devices and at least two of the first charge storage devices; Wherein, the at least two first charge storage devices are respectively arranged on the first substrate and the second substrate.
2. The image sensor as claimed in claim 1, wherein the processing circuit comprises a reset device and a readout device, wherein the reset device is used to reset the second charge storage device, and the readout device is used to process and read out the photogenerated electrons in the charge storage device.
3. The image sensor according to claim 2, wherein the first substrate and the second substrate are distributed along a vertical direction, the first substrate and the second substrate are connected via a bonding conductor, and the first charge storage device and the second charge storage device are electrically connected via a bonding conductor.
4. An electronic device, comprising: A light source, used to emit a light signal to a target object; an image sensor, configured to receive a light signal reflected by the target object and generate an electrical signal, Wherein, the image sensor comprises: A first substrate, comprising a pixel array, wherein the pixel array is composed of pixel units, wherein the pixel units include a photoelectric conversion device, a transmission device and a first charge storage device, wherein the photoelectric conversion device is used to receive a light signal and generate photogenerated electrons, the transmission device is used to control the transmission of the photogenerated electrons, and the charge storage device is used to store the photogenerated electrons transmitted by the transmission device; a second substrate comprising a second charge storage device and a processing circuit, wherein the processing circuit is used to process the photogenerated electrons stored in the first charge storage device and the second charge device; The storage capacity of the second charge storage device is greater than the storage capacity of the first charge storage device; The pixel unit comprises at least two of the transmission devices and at least two of the first charge storage devices; Wherein, the at least two first charge storage devices are respectively arranged on the first substrate and the second substrate.
5. The electronic device as described in claim 4, wherein the processing circuit comprises a reset device and a readout device, wherein the reset device is used to reset the second charge storage device, and the readout device is used to process and read out the photogenerated electrons in the charge storage device.
6. The electronic device as claimed in claim 5, wherein the first substrate and the second substrate are distributed along a vertical direction, the first substrate and the second substrate are connected via a bonding conductor, and the first charge storage device and the second charge storage device are electrically connected via a bonding conductor.
