Image sensor, camera module and electronic equipment
By using a differential circuit to process the voltage signal differentially in the image sensor, the problem of slow acquisition speed of analog-to-digital converters is solved, achieving faster data acquisition and higher acquisition accuracy.
Patent Information
- Application Number
- CN202511524016.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-10-23
- Publication Date
- 2025-12-30
AI Technical Summary
In image sensors, analog-to-digital converters have a low acquisition speed for some pixel data, especially for pixel data with large voltage amplitudes, resulting in a slow acquisition speed.
A differential circuit is used to perform differential processing on the voltage signals output by the first pixel circuit and the second pixel circuit to obtain a differential voltage signal. The voltage amplitude of the differential voltage signal is then acquired by an analog-to-digital converter, reducing the acquisition time.
This improved the acquisition speed and accuracy of the analog-to-digital converter (ADC), reduced acquisition time, and increased the acquisition efficiency of the ADC.
Smart Images

Figure CN121239984A_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application belongs to the technical field of image processing, and particularly relates to an image sensor, a camera module and an electronic device. BACKGROUND
[0002] With the rapid development of electronic devices such as mobile phones, the types of sensors integrated on electronic devices are also increasing. Electronic devices generally use image sensors for photographing. In the image sensor, the related art generally uses an analog-to-digital converter to collect pixel data output by a pixel circuit, that is, to output a digital signal.
[0003] However, in the related art, the analog-to-digital converter in the image sensor has a low collection speed for some pixel data. For example, if the pixel data output by the pixel circuit in the image sensor includes a voltage signal, since the data collection time of the analog-to-digital converter is determined by the voltage amplitude of the pixel data output by the pixel circuit, the greater the voltage amplitude of the pixel data, the longer the time taken by the analog-to-digital converter to collect the pixel data, thereby resulting in a low collection speed of the analog-to-digital converter in the image sensor for some pixel data with a large voltage amplitude. SUMMARY
[0004] The present application provides an image sensor, a camera module and an electronic device, which can use a first differential circuit to differentially process a first voltage signal output by a first pixel circuit and a second voltage signal output by a second pixel circuit to obtain a first differential voltage signal, and then use a first analog-to-digital converter to obtain the voltage amplitude of the first differential voltage signal based on the first differential voltage signal. Since the time taken by the first analog-to-digital converter to collect data is positively correlated with the voltage amplitude of the collected data, the voltage amplitude of the first differential voltage signal is smaller than the voltage amplitude of the first voltage signal, and compared with the time taken by the first analog-to-digital converter to collect data directly from the first voltage signal, the first analog-to-digital converter takes less time to collect the first differential voltage signal, thereby effectively improving the collection speed of the first analog-to-digital converter.
[0005] In a first aspect, an embodiment of the present application provides an image sensor, comprising: a first pixel circuit, a second pixel circuit, a first differential circuit and a first analog-to-digital converter; an output end of the first pixel circuit is coupled to a first end of the first differential circuit, an output end of the second pixel circuit is coupled to a second end of the first differential circuit, and a third end of the first differential circuit is connected to the first analog-to-digital converter; The first differential circuit is configured to differentially process a first voltage signal output by the first pixel circuit and a second voltage signal output by the second pixel circuit to obtain a first differential voltage signal; and the first analog-to-digital converter is configured to obtain the voltage amplitude of the first differential voltage signal based on the first differential voltage signal input to the first analog-to-digital converter by the first differential circuit. The voltage amplitude of the first differential voltage signal is less than the voltage amplitude of the first voltage signal.
[0006] Optionally, the image sensor provided in the embodiments of the present application further comprises an image processing unit, and the first analog-digital converter is connected with the image processing unit. The image processing unit is configured to determine the voltage amplitude of the first voltage signal based on the voltage amplitude of the second voltage signal, the voltage amplitude of the first differential voltage signal, and a first polarity signal input by the first differential circuit to the image processing unit. The voltage amplitude of the second voltage signal is a known quantity, and the first polarity signal is used to represent the size relationship between the voltage amplitude of the first voltage signal and the voltage amplitude of the second voltage signal.
[0007] Optionally, the image sensor provided in the embodiments of the present application further comprises a second analog-digital converter, and the output end of the second pixel circuit is further connected with the second analog-digital converter; the second analog-digital converter is connected with the image processing unit. The second analog-digital converter is configured to obtain the voltage amplitude of the second voltage signal based on a second voltage signal input by the second pixel circuit to the second analog-digital converter.
[0008] Optionally, the image sensor provided in the embodiments of the present application further comprises a third pixel circuit, a second differential circuit, and a third analog-digital converter. The output end of the third pixel circuit is coupled with the first end of the second differential circuit, the output end of the first pixel circuit is further coupled with the second end of the second differential circuit, and the third end of the second differential circuit is connected with the third analog-digital converter. The second differential circuit is configured to perform differential processing on a third voltage signal output by the third pixel circuit and the first voltage signal output by the first pixel circuit to obtain a second differential voltage signal. The third analog-digital converter is configured to obtain the voltage amplitude of the second differential voltage signal based on the second differential voltage signal input by the second differential circuit to the third analog-digital converter. The voltage amplitude of the second differential voltage signal is less than the voltage amplitude of the third voltage signal.
[0009] Optionally, in the image sensor provided in the embodiments of the present application, the third end of the second differential circuit is further connected with the image processing unit. The image processing unit is further configured to determine the voltage amplitude of the third voltage signal based on the voltage amplitude of the first voltage signal, the voltage amplitude of the second differential voltage signal, and a second polarity signal input by the second differential circuit to the image processing unit. The second polarity signal is used to represent the size relationship between the voltage amplitude of the third voltage signal and the voltage amplitude of the first voltage signal.
[0010] Optionally, the image sensor provided by the embodiment of the present application further comprises a first switch and a second switch; The first end of the first switch is connected with the output end of the first pixel circuit, and the second end of the first switch is connected with the first end of the first differential circuit; the first switch is used for conducting the output end of the first pixel circuit and the first end of the first differential circuit; The first end of the second switch is connected with the output end of the second pixel circuit, and the second end of the second switch is connected with the second end of the first differential circuit; the second switch is used for conducting the output end of the second pixel circuit and the second end of the first differential circuit.
[0011] Optionally, in the image sensor provided by the embodiment of the present application, the first differential circuit comprises a first differential amplifier; the first end of the first differential amplifier is coupled with the second end of the first switch, the second end of the first differential amplifier is coupled with the second end of the second switch, and the third end of the first differential amplifier is connected with the first analog-to-digital converter and the image processing unit respectively; The first differential amplifier is used for: differentially processing the first voltage signal and the second voltage signal to obtain a first differential voltage signal and a first polarity signal; outputting the first differential voltage signal to the first analog-to-digital converter, and outputting the first polarity signal to the image processing unit.
[0012] Optionally, in the image sensor provided by the embodiment of the present application, the first differential circuit further comprises a first storage capacitor, a second storage capacitor, a third switch and a fourth switch; The first end of the first storage capacitor is connected with the output end of the first pixel circuit through the first switch; the first end of the first storage capacitor is also connected with the first end of the first differential amplifier through the third switch; and the second end of the first storage capacitor is grounded; The first end of the second storage capacitor is connected with the output end of the second pixel circuit through the second switch; the first end of the second storage capacitor is also connected with the second end of the first differential amplifier through the fourth switch; and the second end of the second storage capacitor is grounded; In the case that the first switch is in the conducting state, the first storage capacitor is used for storing the first voltage signal output by the first pixel circuit; in the case that the second switch is in the conducting state, the second storage capacitor is used for storing the second voltage signal output by the second pixel circuit; In the case that the third switch and the fourth switch are in the conducting state, the first storage capacitor and the second storage capacitor are in the discharging state, and the first differential amplifier is used for differentially processing the first signal and the second signal to obtain the first differential voltage signal and the first polarity signal; The first signal is a first voltage signal released by the first storage capacitor in a discharging state, and the second signal is a second voltage signal released by the second storage capacitor in a discharging state.
[0013] Optionally, the image sensor provided in the embodiment of the present application further comprises a fifth switch and a sixth switch. The first end of the fifth switch is connected with the output end of the third pixel circuit, and the second end of the fifth switch is connected with the first end of the second differential circuit; the fifth switch is used for conducting the output end of the third pixel circuit and the first end of the second differential circuit; The first end of the sixth switch is connected with the output end of the first pixel circuit, and the second end of the sixth switch is connected with the second end of the second differential circuit; the sixth switch is used for conducting the output end of the first pixel circuit and the second end of the second differential circuit.
[0014] Optionally, in the image sensor provided in the embodiment of the present application, the second differential circuit comprises: a second differential amplifier; the first end of the second differential amplifier is coupled with the second end of the fifth switch, the second end of the second differential amplifier is coupled with the second end of the sixth switch, and the third end of the second differential amplifier is connected with the third analog-to-digital converter and the image processing unit respectively; The second differential amplifier is used for: differentially processing the third voltage signal and the first voltage signal to obtain a second differential voltage signal and a second polarity signal; outputting the second differential voltage signal to the third analog-to-digital converter, and outputting the second polarity signal to the image processing unit.
[0015] Optionally, in the image sensor provided in the embodiment of the present application, the second differential circuit further comprises: a seventh switch, an eighth switch, a third storage capacitor and a fourth storage capacitor; The first end of the third storage capacitor is connected with the output end of the third pixel circuit through the fifth switch, and the first end of the third storage capacitor is also connected with the first end of the second differential amplifier through the seventh switch; the second end of the third storage capacitor is grounded; The first end of the fourth storage capacitor is connected with the output end of the first pixel circuit through the sixth switch; the first end of the fourth storage capacitor is also connected with the second end of the second differential amplifier through the eighth switch, and the second end of the fourth storage capacitor is grounded; The third end of the second differential amplifier is connected with the third analog-to-digital converter and the image processing unit respectively; When the fifth switch is in a conducting state, the third storage capacitor is used for storing the third voltage signal output by the third pixel circuit; When the sixth switch is in a conducting state, the fourth storage capacitor is used for storing the first voltage signal output by the first pixel circuit; In a case where the seventh switch and the eighth switch are in a conductive state, the third storage capacitor and the fourth storage capacitor are in a discharging state, and the second differential amplifier is configured to perform differential processing on the third signal and the fourth signal to obtain a second differential voltage signal and a second polarity signal. The third signal is a third voltage signal released by the third storage capacitor in a discharging state, and the fourth signal is a first voltage signal released by the second storage capacitor in a discharging state.
[0016] Optionally, the image sensor provided in the embodiments of the present application comprises a pixel array, and the pixel array comprises at least one multi-spectrum unit. The multi-spectrum unit comprises at least one first type of pixel for multi-spectrum imaging and at least two second types of pixels for image imaging. The first type of pixel in the multi-spectrum unit comprises a first pixel circuit.
[0017] Optionally, in the image sensor provided in the embodiments of the present application, in one multi-spectrum unit, the number ratio of the first type of pixel is less than the number ratio of the second type of pixel. The number ratio of the first type of pixel is the ratio of the number of the first type of pixel to the total number of pixels in the multi-spectrum unit, and the number ratio of the second type of pixel is the ratio of the number of the second type of pixel to the total number of pixels in the multi-spectrum unit.
[0018] In a second aspect, the embodiments of the present application provide a camera module, comprising a processor and the image sensor of the first aspect.
[0019] In a third aspect, the embodiments of the present application provide an electronic device, comprising a housing and the camera module of the second aspect.
[0020] In the embodiments of the present application, the first differential circuit can perform differential processing on the first voltage signal output by the first pixel circuit and the second voltage signal output by the second pixel circuit to obtain a first differential voltage signal, and then the first analog-to-digital converter obtains the voltage amplitude of the first differential voltage signal based on the first differential voltage signal. Since the time spent by the first analog-to-digital converter in collecting data is positively correlated with the voltage amplitude of the collected data, the voltage amplitude of the first differential voltage signal is smaller than the voltage amplitude of the first voltage signal. Compared with the time spent by the first analog-to-digital converter in collecting data directly from the first voltage signal, the first analog-to-digital converter spends less time in collecting data from the first differential voltage signal, thereby effectively improving the collection speed of the first analog-to-digital converter. BRIEF DESCRIPTION OF DRAWINGS
[0021] Figure 1 is a schematic diagram of an image sensor provided by some embodiments of the present application; Figure 2is a schematic diagram of an image sensor provided by some embodiments of the present application; Figure 3 is a schematic diagram of an image sensor provided by some embodiments of the present application; Figure 4 is a schematic diagram of an image sensor provided by some embodiments of the present application; Figure 5 is a schematic diagram of an image sensor provided by some embodiments of the present application; Figure 6A is a schematic diagram of an image sensor provided by some embodiments of the present application; Figure 6B is a schematic diagram of data acquisition time of an analog-to-digital converter within an image sensor provided by some embodiments of the present application; Figure 7 is a partial schematic diagram of an image sensor provided by some embodiments of the present application; Figure 8 is a schematic diagram of a camera module provided by some embodiments of the present application; Figure 9 is a schematic diagram of an electronic device provided by some embodiments of the present application.
[0022] BRIEF DESCRIPTION OF DRAWINGS: 10-Image sensor; 110-First pixel circuit; 120-Second pixel circuit; 130-Third pixel circuit; 210-First differential circuit; 220-Second differential circuit; 310-First analog-digital converter; 320-Second analog-digital converter; 330-Third analog-digital converter; 400-Image processing unit; S1-First switch; S2-Second switch; U1-First differential amplifier; C1-First storage capacitor; C2-Second storage capacitor; S3-Third switch; S4-Fourth switch; S5-Fifth switch; S6-Sixth switch; U2-Second differential amplifier; C3-Third storage capacitor; C4-Fourth storage capacitor; S7-Seventh switch; S8-Eighth switch; PD1-First photoelectric conversion element; PD2-Second photoelectric conversion element; TG1-First transfer transistor; TG2-Second transfer transistor; FD1-First capacitor; RST1-First reset transistor; SF1-First source follower; RS1-First column selection signal switch; VDD-Power voltage; PD3-Third photoelectric conversion element; PD4-Fourth photoelectric conversion element; TG3-Third transfer transistor; TG4-Fourth transfer transistor; FD2-Second capacitor; RST2-Second reset transistor; SF2-Second source follower; RS2-Second column selection signal switch; PD5-Fifth photoelectric conversion element; PD6-Sixth photoelectric conversion element; TG5-Fifth transfer transistor; TG6-Sixth transfer transistor; FD3-Third capacitor; RST3-Third reset transistor; SF3-Third source follower; RS3-Third column selection signal switch; 100-Pixel array; 140-Multi-spectrum unit; 101-First type of pixel; 102-Second type of pixel; 500-Color filter array; 510-Filter unit; 501-First type of filter element; 502-Second type of filter element; V1-First voltage signal; V2-Second voltage signal; V3-Third voltage signal; |V1-V2|-First differential voltage signal; P1-First polarity signal; |V3-V1|-Second differential voltage signal; P2-Second polarity signal; 800-Imaging module; 20-Lens; 30-Driving module; 40-Filtering module; 50-Base; 60-Adhesive; 70-Circuit board; 900-Electronic device; 910-Housing. DETAILED DESCRIPTION
[0023] Embodiments of the present application will be described in detail below with reference to drawings, examples of which are shown in the accompanying drawings, in which the same or similar components have the same or similar designations throughout. The embodiments described below through reference to the drawings are illustrative, and are merely intended to explain the present application, and should not be construed as limiting the present application. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present application without creative work are within the scope of the present application.
[0024] The terms "first", "second" in the specification and claims of the present application can explicitly or implicitly include one or more of the features. In the description of the present application, the meaning of "a plurality of" is two or more, unless otherwise specified. In addition, "and / or" in the specification and claims means at least one of the connected objects, and the character " / ", generally means that the front and rear associated objects are in an "or" relationship.
[0025] In the description of the present application, it should be understood that the orientation or position relationship indicated by the terms "inner", "outer" and the like is based on the orientation or position relationship shown in the drawings, and is only for the convenience of describing the present application and simplifying the description, and does not indicate or imply that the device or element referred to must have a particular orientation, be constructed and operated in a particular orientation, and therefore cannot be understood as a limitation on the present application.
[0026] In the description of the present application, it should be noted that, unless otherwise specified and limited, the terms "connected", "connected" should be understood broadly, for example, it can be fixedly connected, or it can be detachably connected, or integrally connected; it can be mechanically connected, or it can be electrically connected; it can be directly connected, or it can be indirectly connected through an intermediate medium; it can be the communication inside two elements. For those skilled in the art, the specific meaning of the above terms in the present application can be understood according to the specific circumstances.
[0027] The terms used in the embodiment part of the present application are only used to explain the specific embodiments of the present application, and are not intended to limit the present application. The terms related to the embodiments of the present application are explained below.
[0028] Image sensor: a device that converts optical signals into electrical signals and generates images based on the electrical signals. The image sensor can include a pixel array, a color filter array, and a microlens array arranged in sequence. The pixel array can include a plurality of pixel circuits, each of which can include at least one photoelectric conversion element. The color filter array can include a plurality of filter units, each of which can include a plurality of filter elements. The microlens array can include a plurality of microlenses. One pixel circuit is arranged opposite one filter unit, one photoelectric conversion element in one pixel circuit is arranged opposite one filter element in one filter unit, and one filter unit is arranged opposite one microlens. The types of image sensors can include color image sensors, multispectral sensors, event sensors, polarization sensors, or integrated sensors of several types, etc. The specific types and functions of the image sensor are not limited in the embodiments of the present application. In the image sensor, the size and shape of the pixel circuit, the resolution size, the filter element pattern arrangement, the microlens pattern and the number of layers, the number, type and shape of the photoelectric conversion element in the pixel circuit, the exposure mode, etc. can be set according to actual needs, which are not limited in the embodiments of the present application.
[0029] Multispectral sensor: the pixel circuit in the multispectral sensor is used for multispectral imaging, which can specifically identify the spectral information of multiple specific wavelength ranges at the same time. For example, the pixel circuit in the color image sensor is used for RGB image imaging, and the color image sensor can generally identify three wavelength bands of light, such as red, green, and blue. A RGB image is synthesized. Compared with the color image sensor, the multispectral sensor can identify more wavelength bands of light and synthesize a multispectral image. For example, a multispectral sensor for environmental multispectral information identification can simultaneously identify nine, twelve or sixteen wavelength bands of light. The types and channel numbers of the multiple wavelength bands that the multispectral sensor can identify are not limited in the present application.
[0030] Pixel circuit: the pixel circuit can include a photoelectric conversion module, a capacitor module, an output module, and a reset switch; the photoelectric conversion module includes at least one photoelectric conversion element PD and at least one transfer transistor TG, one photoelectric conversion element PD and one transfer transistor TG are connected in series, and a plurality of transfer transistors PD are connected in parallel; the capacitor module can include at least one capacitor FD; the output module can include one source follower SF and one row selection signal switch RS; the reset switch can include one reset transistor RST. The pixel data output by the pixel circuit is voltage data.
[0031] The working principle of the pixel circuit can include the following six steps: first, PD reset and exposure. After the exposure of the previous frame is completed, the reset transistor RST and the transfer transistor TG are activated, and the charge in the PD is emptied. At this time, the potential of the n region reaches the maximum, that is, Vpin. After the reset is completed, the incident light excites the PD to generate photoelectrons, and the photoelectrons are gathered in the potential well. Second, FD reset. Before the exposure is completed, the reset transistor RST is activated again to reset the n+ region of the readout area, that is, the FD, to a high level. Third, reset level readout. After the reset is completed, the reset signal at the FD position is read out, which includes the offset noise of the transistor, the 1 / f noise, and the kTC noise introduced by the reset. The SF switch and the RS switch are opened, and the reset signal at the FD is read out and buffered. Fourth, charge transfer. The transfer transistor TG is activated to completely transfer the charge from the light-sensitive region to the n+ region of the FD. At this time, the voltage signal at the FD position decreases from the reset value, and the decreased value represents the number of photons generated, that is, the photosensitive signal. Fifth, signal level readout. The SF switch and the RS switch are opened again, and the photosensitive signal at the FD is read out and buffered. The signal here includes the signal generated by photoelectric conversion, the offset of the transistor, the 1 / f noise, and the kTC noise introduced by the reset. Sixth, signal output. The two signals read out and buffered are subtracted, and the obtained signal is amplified analogically, and then sampled by an analog-to-digital converter, so as to output a digital signal.
[0032] Analog-to-digital converter (ADC): The analog-to-digital converter is used to convert the pixel data output by the pixel circuit from an analog voltage signal to a digital signal. The digital signal obtained by conversion can be output to an image processing unit for processing.
[0033] Least significant bit (LSB): The LSB is the unit of the output value of the ADC. The sensitivity of the ADC can represent the change amount of the input analog voltage corresponding to the change of 1 minimum digital code of the digital output of the ADC. For example, if the sensitivity of the ADC is 2 mV / LSB, the analog voltage signal input by the ADC changes by 2 mV, and the output value of the ADC changes by 1 LSB. For example, if the analog voltage signal input by the ADC changes by 0.2 V, the output value of the ADC changes by 100 LSBs.
[0034] Image Signal Processor (ISP): The digital signal after analog-to-digital conversion by the ADC is processed by the ISP and encoded into a MIPI signal for output, converting the original image data into a high-quality image. The ISP can be located inside or outside the image sensor; this application embodiment does not limit the specific location of the ISP.
[0035] The image sensor and electronic device provided in the embodiments of this application are described in detail below with reference to the accompanying drawings.
[0036] like Figure 1 As shown, this application embodiment provides an image sensor 10, which may include: a first pixel circuit 110, a second pixel circuit 120, a first differential circuit 210, and a first analog-to-digital converter 310; the output terminal of the first pixel circuit 110 is coupled to the first terminal of the first differential circuit 210, the output terminal of the second pixel circuit 120 is coupled to the second terminal of the first differential circuit 210, and the third terminal of the first differential circuit 210 is connected to the first analog-to-digital converter 310; The first differential circuit 210 is used to perform differential processing on the first voltage signal V1 output by the first pixel circuit 110 and the second voltage signal V2 output by the second pixel circuit 120 to obtain the first differential voltage signal |V1-V2|; the first analog-to-digital converter 310 is used to obtain the voltage amplitude of the first differential voltage signal based on the first differential voltage signal input to the first analog-to-digital converter 310 by the first differential circuit 210. The pixel data output by the first pixel circuit 110 may include a first voltage signal V1; the pixel data output by the second pixel circuit 120 may include a second voltage signal V2; the first differential circuit 210 may perform differential processing on the first voltage signal V1 output by the first pixel circuit 110 and the second voltage signal V2 output by the second pixel circuit 120 to obtain a first differential voltage signal |V1-V2|.
[0037] The voltage amplitude of the first differential voltage signal |V1-V2| can characterize the difference between the voltage amplitude of the first voltage signal V1 and the voltage amplitude of the second voltage signal V2.
[0038] Among them, the voltage amplitude of the first differential voltage signal |V1-V2| is less than the voltage amplitude of the first voltage signal V1.
[0039] In the embodiments of the present application, the time taken by the first analog-to-digital converter 310 to collect data is positively correlated with the voltage amplitude of the collected data. The greater the voltage amplitude of the collected data, the longer the time taken by the first analog-to-digital converter 310 to collect data, and the slower the collection speed of the first analog-to-digital converter 310. Conversely, the smaller the voltage amplitude of the collected data, the shorter the time taken by the first analog-to-digital converter 310 to collect data, and the faster the collection speed of the first analog-to-digital converter 310.
[0040] It should be noted that, compared with the first analog-to-digital converter directly collecting the first voltage signal V1 in the related art, the first analog-to-digital converter 310 in the embodiments of the present application collects not the first voltage signal V1 but the first differential voltage signal |V1-V2|. Since the voltage amplitude of the first differential voltage signal |V1-V2| represents the difference between the voltage amplitude of the first voltage signal V1 and the voltage amplitude of the second voltage signal V2, it is obviously smaller than the voltage amplitude of the first voltage signal V1. Therefore, the time taken by the first analog-to-digital converter 310 in the embodiments of the present application to collect the first differential voltage signal |V1-V2| is obviously less than the time taken by the first analog-to-digital converter to directly collect the first voltage signal V1 in the related art.
[0041] In this way, the image sensor 10 provided by some embodiments of the present application can be configured to set a first differential circuit 210 between the first pixel circuit 110, the second pixel circuit 120, and the first analog-to-digital converter 310. The first differential circuit 210 can perform differential processing on the first voltage signal V1 output by the first pixel circuit 110 and the second voltage signal V2 output by the second pixel circuit 120 to obtain the first differential voltage signal |V1-V2|. Then, the first analog-to-digital converter 310 obtains the voltage amplitude of the first differential voltage signal |V1-V2| based on the first differential voltage signal |V1-V2| input by the first differential circuit 210 to the first analog-to-digital converter 310. Since the time taken by the first analog-to-digital converter 310 to collect data is positively correlated with the voltage amplitude of the collected data, the voltage amplitude of the first differential voltage signal |V1-V2| is smaller than the voltage amplitude of the first voltage signal V1. Compared with the time taken by the first analog-to-digital converter 310 to directly collect the first voltage signal V1, the first analog-to-digital converter 310 takes less time to collect the first differential voltage signal |V1-V2|, thereby effectively improving the collection speed of the first analog-to-digital converter 310.
[0042] Moreover, in actual applications, since the embodiments of the present application improve the single collection speed of the first analog-to-digital converter 310 for pixel data, the first analog-to-digital converter 310 can collect more data for mean value calculation in the same time period, thereby further improving the data collection accuracy of the first analog-to-digital converter 310.
[0043] In some embodiments of this application, in order to improve the speed of acquiring the first voltage signal V1, the first analog-to-digital converter 310 of this application embodiment can acquire the difference between the first voltage signal V1 and the second voltage signal V2, that is, the voltage amplitude of the first differential voltage signal |V1-V2|, and then obtain the voltage amplitude of the first voltage signal V1 based on the known voltage amplitude of the second voltage signal V2 and the acquired voltage amplitude of the first differential voltage signal |V1-V2|.
[0044] The voltage amplitude of the second voltage signal V2 is a known quantity.
[0045] The voltage amplitude of the first differential voltage signal |V1-V2| acquired by the first analog-to-digital converter 310 can characterize the difference between the voltage amplitude of the first voltage signal V1 and the voltage amplitude of the second voltage signal V2.
[0046] The third terminal of the first differential circuit 210 can also output a first polarity signal P1, which characterizes the relationship between the voltage amplitude of the first voltage signal V1 and the voltage amplitude of the second voltage signal V2. For example, a first polarity signal P1 of "0" indicates that the voltage amplitude of the first voltage signal V1 is greater than that of the second voltage signal V2, and a first polarity signal P1 of "1" indicates that the voltage amplitude of the first voltage signal V1 is less than that of the second voltage signal V2. Alternatively, a first polarity signal P1 of "0" indicates that the voltage amplitude of the first voltage signal V1 is less than that of the second voltage signal V2, and a first polarity signal P1 of "1" indicates that the voltage amplitude of the first voltage signal V1 is greater than that of the second voltage signal V2. This application does not impose specific limitations in this regard.
[0047] The voltage amplitude of the first voltage signal V1 can be obtained based on the voltage amplitude of the second voltage signal V2, the voltage amplitude of the first differential voltage signal |V1-V2| acquired by the first analog-to-digital converter 310, and the first polarity signal P1 output by the first differential circuit 210.
[0048] For example, when the first polarity signal P1 indicates that the voltage amplitude of the first voltage signal V1 is greater than the voltage amplitude of the second voltage signal V2, the voltage amplitude of the second voltage signal V2 is added to the voltage amplitude of the first differential voltage signal |V1-V2| to determine the voltage amplitude of the first voltage signal V1. When the first polarity signal P1 indicates that the voltage amplitude of the first voltage signal V1 is less than the voltage amplitude of the second voltage signal V2, the voltage amplitude of the second voltage signal V2 is subtracted from the voltage amplitude of the first differential voltage signal |V1-V2| to determine the voltage amplitude of the first voltage signal V1.
[0049] For example, such as Figure 2 As shown, the image sensor 10 provided in this application embodiment may further include an image processing unit 400, a first analog-to-digital converter 310 connected to the image processing unit 400, and a third terminal of the first differential circuit 210 also connected to the image processing unit 400. The image processing unit 400 is used to determine the voltage amplitude of the first voltage signal V1 based on the voltage amplitude of the second voltage signal V2, the voltage amplitude of the first differential voltage signal |V1-V2|, and the first polarity signal P1 input to the image processing unit 400 by the first differential circuit 210.
[0050] For example, if the voltage amplitude of the second voltage signal V2 is 2.3V, the voltage amplitude of the first differential voltage signal |V1-V2| is 0.2V, and the first polarity signal P1 indicates that the voltage amplitude of the first voltage signal V1 is greater than the voltage amplitude of the second voltage signal V2, then the voltage amplitude of the first voltage signal V1 is determined to be 2.5V. Assuming that in related technologies, the first analog-to-digital converter (ADC) takes 10ms to directly acquire the 2.5V pixel data output from the first voltage signal V1, while in this embodiment, the first ADC 310 takes 4ms to acquire the 0.2V data from the first differential voltage signal |V1-V2|. Compared with related technologies, the time for the first ADC 310 to acquire pixel data is effectively reduced by 6ms, thereby improving the single-shot acquisition speed of the pixel data by the first ADC 310.
[0051] Of course, in other embodiments of this application, the image processing unit may also be disposed outside the image sensor (not shown in the figure). This application does not impose specific restrictions on the specific location of the image processing unit.
[0052] Thus, some embodiments of this application can determine the voltage amplitude of the first voltage signal V1 based on the voltage amplitude of the second voltage signal V2, the voltage amplitude of the first differential voltage signal |V1-V2| obtained by the first analog-to-digital converter 310, and the first polarity signal P1 input to the first differential circuit. This allows the first analog-to-digital converter 310 to only collect the difference between the first voltage signal V1 and the second voltage signal V2. Subsequently, the voltage amplitude of the first voltage signal V1 can be obtained based on the known voltage amplitude of the second voltage signal V2 and the voltage amplitude of the first differential voltage signal |V1-V2| collected by the first differential circuit 210. This improves the single-shot acquisition speed of pixel data by the first analog-to-digital converter 310.
[0053] The above description indicates that the voltage amplitude of the second voltage signal V2 is a known quantity in the process of determining the voltage amplitude of the first voltage signal V1. To determine the voltage amplitude of the second voltage signal V2, in some embodiments of this application, such as... Figure 2As shown, the image sensor 10 provided in this application embodiment may further include a second analog-to-digital converter 320; the output terminal of the second pixel circuit 120 is also connected to the second analog-to-digital converter 320; the second analog-to-digital converter 320 is connected to the image processing unit 400; The second analog-to-digital converter 320 is used to obtain the voltage amplitude of the second voltage signal based on the second voltage signal V2 input to the second analog-to-digital converter 320 from the second pixel circuit 120.
[0054] For example, if the voltage amplitude of the second voltage signal V2 is 2.3V, the second analog-to-digital converter 320 can directly acquire the second voltage signal V2 input to the second pixel circuit 120, and the time taken to acquire the pixel data 2.3V output by the second voltage signal V2 is 7ms.
[0055] In some embodiments of this application, the second analog-to-digital converter 320 can be used to directly acquire the second voltage signal V2 input to the second pixel circuit 120; in other embodiments of this application, the second analog-to-digital converter can be used to acquire the difference between the second pixel circuit and other pixel circuits, and then the voltage amplitude of the second voltage signal V2 output by the second pixel circuit 120 can be indirectly calculated; the embodiments of this application do not limit the specific method of determining the voltage amplitude of the second voltage signal V2.
[0056] For example, such as Figure 2 As shown, when the output of the second pixel circuit 120 is directly connected to the second analog-to-digital converter 320, the embodiment of this application can use the second analog-to-digital converter 320 to directly acquire the second voltage signal V2 input to the second pixel circuit 120, determine the voltage amplitude of the second voltage signal V2, and thus the image processing unit 100 obtains the voltage amplitude of the second voltage signal V2 input to the second analog-to-digital converter 320.
[0057] For example, in other embodiments of this application, a second analog-to-digital converter (ADC) can be used to acquire the differences between the second pixel circuit and other pixel circuits, and then the voltage amplitude of the second voltage signal V2 output by the second ADC 320 can be indirectly calculated. For instance, in other embodiments of this application (not shown), when the image sensor also includes a second ADC, a fourth pixel circuit, and a third differential circuit, the output terminals of the second and fourth pixel circuits are connected to the second ADC via the third differential circuit. The third differential circuit can be used to perform differential calculations on the second voltage signal output by the second pixel circuit and the fourth voltage signal output by the fourth pixel circuit to obtain a third differential signal. The second ADC is used to obtain the voltage amplitude of the third differential signal based on the input third differential signal. Then, the image processing unit determines the voltage amplitude of the second voltage signal V2 based on the voltage amplitude of the third differential signal and the voltage amplitude of the fourth voltage signal.
[0058] Thus, in this embodiment of the application, the voltage amplitude of the second voltage signal V2 can be obtained by the second analog-to-digital converter 320, so that the image processing unit 400 can subsequently calculate the voltage amplitude of the first voltage signal V1 based on the known voltage amplitude of the second voltage signal V2 and the voltage amplitude of the first differential voltage signal |V1-V2| acquired by the first analog-to-digital converter 310.
[0059] In some embodiments of this application, after the image processing unit 400 determines the voltage amplitude of the first voltage signal V1 output by the first pixel circuit 110, the embodiments of this application may further improve the acquisition speed of the voltage amplitude of the third voltage signal V3 output by the third pixel circuit 130 by using the voltage amplitude of the first voltage signal V1 as a known quantity.
[0060] For example, such as Figure 3 As shown, the image sensor 10 provided in this application embodiment may further include a third pixel circuit 130, a second differential circuit 220, and a third analog-to-digital converter 330; The output terminal of the third pixel circuit 130 is coupled to the first terminal of the second differential circuit 220, the output terminal of the first pixel circuit 110 is also coupled to the second terminal of the second differential circuit 220, and the third terminal of the second differential circuit 220 is connected to the third analog-to-digital converter 330. The second differential circuit 220 is used to perform differential processing on the third voltage signal V3 output by the third pixel circuit 130 and the first voltage signal V1 output by the first pixel circuit to obtain the second differential voltage signal |V3-V1|. The third analog-to-digital converter 330 is used to obtain the voltage amplitude of the second differential voltage signal based on the second differential voltage signal |V3-V1| input to the third analog-to-digital converter 330 from the second differential circuit 220; Among them, the voltage amplitude of the second differential voltage signal |V3-V1| is less than the voltage amplitude of the third voltage signal V3.
[0061] Specifically, the time taken for the third analog-to-digital converter (ADC) 330 to acquire data is positively correlated with the voltage amplitude of the acquired data. The larger the voltage amplitude of the acquired data, the longer the acquisition time for the ADC 330, and the slower its acquisition speed. Conversely, the smaller the voltage amplitude of the acquired data, the shorter the acquisition time for the ADC 330, and the faster its acquisition speed.
[0062] In this embodiment, a second differential circuit 220 is provided between the third pixel circuit 130, the first pixel circuit 110, and the third analog-to-digital converter 330. The second differential circuit 220 can perform differential processing on the third voltage signal V3 output by the third pixel circuit 130 and the first voltage signal V1 output by the first pixel circuit 110 to obtain a second differential voltage signal |V3-V1|. The voltage amplitude of the second differential voltage signal |V3-V1| is less than the voltage amplitude of the third voltage signal V3. Thus, compared with the time spent by the third analog-to-digital converter 330 to directly acquire data from the third voltage signal V3, the acquisition time spent by the third analog-to-digital converter 330 to acquire the second differential voltage signal |V3-V1| is less, thereby effectively improving the acquisition speed of the third analog-to-digital converter 330.
[0063] Thus, in some embodiments of this application, the image sensor 10 can have a second differential circuit 220 disposed between the third pixel circuit 130, the first pixel circuit 110, and the third analog-to-digital converter 330. The second differential circuit 220 can perform differential processing on the third voltage signal V3 output by the third pixel circuit 130 and the first voltage signal V1 output by the first pixel circuit 110 to obtain a second differential voltage signal |V3-V1|. Then, the third analog-to-digital converter 330 obtains a second differential voltage based on the input second differential voltage signal |V3-V1|. Since the time spent by the third analog-to-digital converter 330 in acquiring data is positively correlated with the voltage amplitude of the acquired data, the voltage amplitude of the second differential voltage signal |V3-V1| is smaller than the voltage amplitude of the third voltage signal V3. Compared with the time spent by the third analog-to-digital converter 330 in directly acquiring data from the third voltage signal V3, the acquisition time spent by the third analog-to-digital converter 330 in acquiring the second differential voltage signal |V3-V1| is less, thus effectively improving the acquisition speed of the third analog-to-digital converter 330.
[0064] Furthermore, in practical applications, since the embodiments of this application improve the single acquisition speed of pixel data by the third analog-to-digital converter 330, the third analog-to-digital converter 330 acquires pixel data more times in the same time period, thereby acquiring more data for averaging calculation and effectively improving the acquisition accuracy of the third analog-to-digital converter 330.
[0065] To improve the speed of acquiring the third voltage signal V3, this embodiment of the application can acquire the difference between the third voltage signal V3 and the first voltage signal V1, namely the voltage amplitude of the second differential voltage signal |V3-V1|. Then, based on the known voltage amplitude of the first voltage signal V1 and the acquired voltage amplitude of the second differential voltage signal |V3-V1|, the voltage amplitude of the third voltage signal V3 is obtained.
[0066] The voltage amplitude of the first voltage signal V1 is a known quantity.
[0067] The voltage amplitude of the second differential voltage signal |V3-V1| acquired by the third analog-to-digital converter 330 can characterize the difference between the voltage amplitude of the third voltage signal V3 and the voltage amplitude of the first voltage signal V1.
[0068] The third terminal of the second differential circuit 220 can also output a second polarity signal P2, which is used to characterize the relationship between the voltage amplitude of the third voltage signal V3 and the voltage amplitude of the first voltage signal V1. For example, a second polarity signal P2 of "0" indicates that the voltage amplitude of the third voltage signal V3 is greater than that of the first voltage signal V1, and a second polarity signal P2 of "1" indicates that the voltage amplitude of the third voltage signal V3 is less than that of the first voltage signal V1. Alternatively, a second polarity signal P2 of "0" indicates that the voltage amplitude of the third voltage signal V3 is less than that of the first voltage signal V1, and a second polarity signal P2 of "1" indicates that the voltage amplitude of the third voltage signal V3 is greater than that of the first voltage signal V1. This application does not impose specific limitations in this regard.
[0069] The voltage amplitude of the third voltage signal V3 can be obtained based on the voltage amplitude of the first voltage signal V1, the voltage amplitude of the second differential voltage signal |V3-V1| acquired by the third analog-to-digital converter 330, and the second polarity signal P2 output by the second differential circuit 220.
[0070] For example, when the voltage amplitude of the third voltage signal V3, represented by the second polarity signal P2, is greater than the voltage amplitude of the first voltage signal V1, the voltage amplitude of the first voltage signal V1 is added to the voltage amplitude of the second differential voltage signal |V3-V1| to determine the voltage amplitude of the third voltage signal V3. When the voltage amplitude of the third voltage signal V3, represented by the second polarity signal P2, is less than the voltage amplitude of the first voltage signal V1, the voltage amplitude of the first voltage signal V1 is subtracted from the voltage amplitude of the second differential voltage signal |V3-V1| to determine the voltage amplitude of the third voltage signal V3.
[0071] For example, such as Figure 3 As shown, the third terminal of the second differential circuit 220 is also connected to the image processing unit 400; The image processing unit 400 is also used to determine the voltage amplitude of the third voltage signal V3 based on the voltage amplitude of the first voltage signal V1, the voltage amplitude of the second differential voltage signal |V3-V1|, and the second polarity signal P2 input to the image processing unit 400 by the second differential circuit 220. The second polarity signal P2 is used to characterize the relationship between the voltage amplitude of the third voltage signal V3 and the voltage amplitude of the first voltage signal V1.
[0072] Thus, some embodiments of this application can determine the voltage amplitude of the third voltage signal V3 based on the voltage amplitude of the first voltage signal V1, the voltage amplitude of the second differential voltage signal |V3-V1| acquired by the third analog-to-digital converter 330, and the second polarity signal P2 input to the second differential circuit 220. This allows the third analog-to-digital converter 330 to acquire only the difference between the third voltage signal V3 and the first voltage signal V1. Subsequently, the voltage amplitude of the third voltage signal V3 can be obtained based on the known voltage amplitude of the first voltage signal V1 and the voltage amplitude of the second differential voltage signal |V3-V1| acquired by the second differential circuit 220. This improves the acquisition speed of the third analog-to-digital converter 330.
[0073] In some embodiments of this application, in order to control the first voltage signal V1 output by the first pixel circuit 110 and the second voltage signal V2 output by the second pixel circuit 120 to be respectively input to the second terminal of the first terminal of the first differential circuit 210, such as... Figure 4 As shown, the image sensor 10 provided in this application embodiment may further include a first switch S1 and a second switch S2; The first terminal of the first switch S1 is connected to the output terminal of the first pixel circuit 110, and the second terminal of the first switch S1 is connected to the first terminal of the first differential circuit 210; the first switch S1 is used to connect the output terminal of the first pixel circuit 110 to the first terminal of the first differential circuit 210. The first end of the second switch S2 is connected to the output end of the second pixel circuit 120, and the second end of the second switch S2 is connected to the second end of the first differential circuit 210; the second switch S2 is used to connect the output end of the second pixel circuit 120 to the second end of the first differential circuit 210.
[0074] The first switch S1 may include an NMOS transistor or a PMOS transistor, and this application is not limited thereto. The second switch S2 may include an NMOS transistor or a PMOS transistor, and this application is not limited thereto.
[0075] Thus, in some embodiments of this application, by turning on the first switch S1, the first terminal of the first differential circuit 210 can input a first voltage signal V1 from the output terminal of the first pixel circuit 110, and by turning on the second switch S2, the second terminal of the first differential circuit 210 can input a second voltage signal V2 from the output terminal of the second pixel circuit 120.
[0076] In some embodiments of this application, in order to perform differential processing on the first voltage signal V1 and the second voltage signal V2, such as Figure 4 As shown, in the image sensor 10 provided in this application embodiment, the first differential circuit 210 may include: a first differential amplifier U1; the first terminal of the first differential amplifier U1 is coupled to the second terminal of the first switch S1, the second terminal of the first differential amplifier U1 is coupled to the second terminal of the second switch S2, and the third terminal of the first differential amplifier U1 is connected to the first analog-to-digital converter 310 and the image processing unit 400 respectively. The first differential amplifier U1 is used to: perform differential processing on the first voltage signal V1 and the second voltage signal V2 to obtain the first differential voltage signal |V1-V2| and the first polarity signal P1; output the first differential voltage signal |V1-V2| to the first analog-to-digital converter 310; and output the first polarity signal P1 to the image processing unit 400.
[0077] In this embodiment, the first terminal of the first differential amplifier U1 is the positive input terminal, the second terminal of the first differential amplifier U1 is the negative input terminal, and the third terminal of the first differential amplifier U1 is the output terminal. Alternatively, in other embodiments of this application, the first terminal of the first differential amplifier U1 is the negative input terminal, the second terminal of the first differential amplifier U1 is the positive input terminal, and the third terminal of the first differential amplifier U1 is the output terminal.
[0078] When both the first switch S1 and the second switch S2 are turned on, the first terminal of the first differential amplifier U1 receives a first voltage signal V1 from the output terminal of the first pixel circuit 110, and the second terminal of the first differential amplifier U1 receives a second voltage signal V2 from the output terminal of the second pixel circuit 120. Then, the first differential amplifier U1 performs differential processing on the first voltage signal V1 and the second voltage signal V2 to obtain a first differential voltage signal |V1-V2| and a first polarity signal P1. Then, the first differential amplifier U1 outputs the first differential voltage signal |V1-V2| to the first analog-to-digital converter 310, and the first differential amplifier U1 outputs the first polarity signal P1 to the image processing unit 400.
[0079] Thus, in some embodiments of this application, the first differential amplifier U1 can be used to differentially process the first voltage signal V1 and the second voltage signal V2 to obtain the first differential voltage signal |V1-V2| and the first polarity signal P1. The first differential voltage signal |V1-V2| can characterize the difference in voltage amplitude between the first voltage signal V1 and the second voltage signal V2, and the first polarity signal P1 can characterize the magnitude relationship between the first voltage signal V1 and the second voltage signal V2.
[0080] In some embodiments of this application, in order to simultaneously input a first voltage signal V1 to the first terminal of the first differential amplifier U1 and a second voltage signal V2 to the second terminal of the first differential amplifier U1, such as... Figure 4 As shown, in the image sensor 10 provided in this application embodiment, the first differential circuit 210 may further include: a first storage capacitor C1, a second storage capacitor C2, a third switch S3 and a fourth switch S4; The first terminal of the first storage capacitor C1 is connected to the output terminal of the first pixel circuit 110 through the first switch S1; the first terminal of the first storage capacitor C1 is also connected to the first terminal of the first differential amplifier U1 through the third switch S3; the second terminal of the first storage capacitor C1 is grounded. The first terminal of the second storage capacitor C2 is connected to the output terminal of the second pixel circuit 120 through the second switch S2; the first terminal of the second storage capacitor C2 is also connected to the second terminal of the first differential amplifier U2 through the fourth switch S4; the second terminal of the second storage capacitor C2 is grounded. When the first switch S1 is in the on state, the first storage capacitor C1 is used to store the first voltage signal V1 output by the first pixel circuit 110; when the second switch S2 is in the on state, the second storage capacitor C2 is used to store the second voltage signal V2 output by the second pixel circuit 120. When the third switch S3 and the fourth switch S4 are in the on state, the first storage capacitor C1 and the second storage capacitor C2 are in the discharge state. The first differential amplifier U1 is used to perform differential processing on the first signal and the second signal to obtain the first differential voltage signal |V1-V2| and the first polarity signal P1.
[0081] The first signal is the first voltage signal V1 released by the first storage capacitor C1 in the discharge state, and the second signal is the second voltage signal V2 released by the second storage capacitor C2 in the discharge state.
[0082] Thus, some embodiments of this application can temporarily store the first voltage signal V1 and the second voltage signal V2 using the first storage capacitor C1 and the second storage capacitor C2. Then, by simultaneously turning on the third switch S3 and the fourth switch S4, the first voltage signal V1 is input to the first terminal of the first differential amplifier U1, and the second voltage signal V2 is simultaneously input to the second terminal of the first differential amplifier U1. This allows the first differential amplifier U1 to perform differential processing on the first voltage signal V1 released by the first storage capacitor C1 and the second voltage signal V2 released by the second storage capacitor C2 to obtain the first differential voltage signal |V1-V2| and the first polarity signal P1.
[0083] In some embodiments of this application, in order to control the third voltage signal V3 output by the third pixel circuit 130 and the first voltage signal V1 output by the first pixel circuit 110 to be respectively input to the second terminal of the first terminal of the second differential circuit 220, such as Figure 5 As shown, the image sensor 10 provided in this application embodiment may further include a fifth switch S5 and a sixth switch S6; The first end of the fifth switch S5 is connected to the output end of the third pixel circuit 130, and the second end of the fifth switch S5 is connected to the first end of the second differential circuit 220; the fifth switch S5 is used to connect the output end of the third pixel circuit 130 to the first end of the second differential circuit 220. The first end of the sixth switch S6 is connected to the output end of the first pixel circuit 110, and the second end of the sixth switch S6 is connected to the second end of the second differential circuit 220; the sixth switch S6 is used to connect the output end of the first pixel circuit 110 to the second end of the second differential circuit 220.
[0084] The fifth switch S5 may include an NMOS transistor or a PMOS transistor, and this application is not limited in this regard. The sixth switch S6 may include an NMOS transistor or a PMOS transistor, and this application is not limited in this regard.
[0085] Thus, in some embodiments of this application, the first terminal of the second differential circuit 220 can be input with a third voltage signal V3 from the output terminal of the third pixel circuit 130 by turning on the fifth switch S5, and the second terminal of the second differential circuit 220 can be input with a second voltage signal V1 from the output terminal of the first pixel circuit 110 by turning on the sixth switch S6.
[0086] In some embodiments of this application, in order to perform differential processing on the third voltage signal V3 and the first voltage signal V1, such as Figure 5 As shown, in the image sensor 10 provided in this application embodiment, the second differential circuit 220 may include: a second differential amplifier U2; the first terminal of the second differential amplifier U2 is coupled to the second terminal of the fifth switch S5, the second terminal of the second differential amplifier U2 is coupled to the second terminal of the sixth switch S6, and the third terminal of the second differential amplifier U2 is connected to the third analog-to-digital converter 330 and the image processing unit 400 respectively. The second differential amplifier U2 is used to: perform differential processing on the third voltage signal V3 and the first voltage signal V1 to obtain the second differential voltage signal |V3-V1| and the second polarity signal; output the second differential voltage signal |V3-V1| to the third analog-to-digital converter 330; and output the second polarity signal P2 to the image processing unit 400.
[0087] In this embodiment, the first terminal of the second differential amplifier U2 is the positive input terminal, the second terminal of the second differential amplifier U2 is the negative input terminal, and the third terminal of the second differential amplifier U2 is the output terminal. Alternatively, in other embodiments of this application, the first terminal of the second differential amplifier U2 is the negative input terminal, the second terminal of the second differential amplifier U2 is the positive input terminal, and the third terminal of the second differential amplifier U2 is the output terminal.
[0088] When both the fifth switch S5 and the sixth switch S6 are simultaneously turned on, the first terminal of the second differential amplifier U2 can receive the third voltage signal V3 from the output terminal of the third pixel circuit 130, and the second terminal of the second differential amplifier U2 can receive the second voltage signal V1 from the output terminal of the first pixel circuit 110. Then, the second differential amplifier U2 performs differential processing on the third voltage signal V3 and the first voltage signal V1 to obtain the second differential voltage signal |V3-V1| and the second polarity signal P2. Then, the second differential amplifier U2 outputs the second differential voltage signal |V3-V1| to the third analog-to-digital converter 330, and the second differential amplifier U2 outputs the second polarity signal P2 to the image processing unit 400.
[0089] Thus, in some embodiments of this application, the second differential amplifier U2 can be used to differentially process the third voltage signal V3 and the first voltage signal V1 to obtain the second differential voltage signal |V3-V1| and the second polarity signal P2. The second differential voltage signal |V3-V1| can characterize the difference in voltage amplitude between the third voltage signal V3 and the first voltage signal V1, and the second polarity signal P2 can characterize the magnitude relationship between the third voltage signal V3 and the first voltage signal V1.
[0090] In some embodiments of this application, in order to simultaneously input the third voltage signal V3 to the first terminal of the second differential amplifier U2 and the first voltage signal V1 to the second terminal of the second differential amplifier U2, such as... Figure 5 As shown, in the image sensor 10 provided in this application embodiment, the second differential circuit 220 further includes: a seventh switch S7, an eighth switch S8, a third storage capacitor C3, and a fourth storage capacitor C4; The first end of the third storage capacitor C3 is connected to the output end of the third pixel circuit 130 through the fifth switch S5. The first end of the third storage capacitor C3 is also connected to the first end of the second differential amplifier U2 through the seventh switch S7. The second end of the third storage capacitor C3 is grounded. The first terminal of the fourth storage capacitor C4 is connected to the output terminal of the first pixel circuit 110 through the sixth switch S6; the first terminal of the fourth storage capacitor C4 is also connected to the second terminal of the second differential amplifier U2 through the eighth switch S8, and the second terminal of the fourth storage capacitor C4 is grounded. The third terminal of the second differential amplifier U2 is connected to the third analog-to-digital converter 330 and the image processing unit 400, respectively. When the fifth switch S5 is in the on state, the third storage capacitor C3 is used to store the third voltage signal V3 output by the third pixel circuit 130. When the sixth switch S6 is in the on state, the fourth storage capacitor C4 is used to store the first voltage signal V1 output by the first pixel circuit 110. When the seventh switch S7 and the eighth switch S8 are in the on state, the third storage capacitor C3 and the fourth storage capacitor C4 are in the discharge state. The second differential amplifier U2 is used to perform differential processing on the third signal and the fourth signal to obtain the second differential voltage signal |V3-V1| and the second polarity signal P2. Among them, the third signal is the third voltage signal V3 released by the third storage capacitor C3 in the discharge state, and the fourth signal is the first voltage signal V1 released by the second storage capacitor C2 in the discharge state.
[0091] Thus, in some embodiments of this application, the third storage capacitor C3 and the fourth storage capacitor C4 can be used to temporarily store the third voltage signal V3 and the first voltage signal V1. Then, by simultaneously turning on the seventh switch S7 and the eighth switch S8, the third voltage signal V3 is input to the first terminal of the second differential amplifier U2, and the first voltage signal V1 is simultaneously input to the second terminal of the second differential amplifier U2. This allows the second differential amplifier U2 to perform differential processing on the third voltage signal V3 released by the third storage capacitor C3 and the first voltage signal V1 released by the fourth storage capacitor C4 to obtain the second differential voltage signal |V3-V1| and the second polarity signal P2.
[0092] In practical applications, we will take the example of an image sensor where each pixel circuit includes two photoelectric conversion elements (PD) and two transfer transistors (TG) for illustration.
[0093] like Figure 6A As shown, in the image sensor 10 provided in this application embodiment, the second pixel circuit 120 may include a first photoelectric conversion element PD1, a second photoelectric conversion element PD2, a first transfer transistor TG1, a second transfer transistor TG2, a first capacitor FD1, a first reset transistor RST1, a first source follower SF1, and a first column select signal switch RS1.
[0094] Regarding the second pixel circuit 120, ignoring the reset signal readout step and focusing on the photosensitive signal readout step, the workflow of the second pixel circuit 120 includes: The first step involves exposing the first photoelectric conversion element PD1. Under the excitation of incident light, the first photoelectric conversion element PD1 generates photosensitive electrons, which accumulate within the potential hydrazine.
[0095] The second step involves charge transfer and photosensitive signal readout from the first photoelectric conversion element PD1. By activating the first transfer transistor TG1, the charge of the photosensitive electrons generated by PD1 is transferred from the photosensitive area to the n+ region of the first capacitor FD1. At this time, the voltage signal of the first capacitor FD1 is the photosensitive signal, i.e., the second voltage signal V2. In this case, the first source follower SF1 and the first column select signal switch RS1 are turned on, and the second analog-to-digital converter 320 is used to read out and buffer the second voltage signal V2 generated by the first photoelectric conversion element FD1.
[0096] Thirdly, as the second voltage signal V2 enters the second analog-to-digital converter 320, the second switch S2 is turned on, allowing the second voltage signal V2 to also enter the second storage capacitor C2 for storage. That is, when the second switch S2 is on, the second storage capacitor C2 is used to store the second voltage signal V2.
[0097] In addition, such as Figure 6AAs shown, in the image sensor 10 provided in this application embodiment, the first pixel circuit 110 may include a third photoelectric conversion element PD3, a fourth photoelectric conversion element PD4, a third transfer transistor TG3, a fourth transfer transistor TG4, a second capacitor FD2, a second reset transistor RST2, a second source follower SF2, and a second column select signal switch RS2.
[0098] For the first pixel circuit 110, ignoring the reset signal readout step and focusing on the photosensitive signal readout step, the workflow of the first pixel circuit 110 may include: The first step involves exposing the third photoelectric conversion element PD3. Under the excitation of incident light, the third photoelectric conversion element PD3 generates photosensitive electrons, which accumulate within the potential hydrazine.
[0099] The second step involves charge transfer and photosensitive signal readout from the third photoelectric conversion element PD3. By activating the third transfer transistor TG3, the charge of the photosensitive electrons generated by the third photoelectric conversion element PD3 is transferred from the photosensitive area to the n+ region of the second capacitor FD2. At this time, the voltage signal of the second capacitor FD2 is the photosensitive signal, i.e., the first voltage signal V1. In this case, by turning on the second source follower SF2, the second column select signal switch RS2, and the first switch S1, the first voltage signal V1 in the second capacitor FD2 flows to the first storage capacitor C1 for storage. In other words, when the second source follower SF2, the second column select signal switch RS2, and the first switch S1 are all turned on, the first storage capacitor C1 is used to store the first voltage signal V1.
[0100] Additionally, the sixth switch S6 can be turned on at this time, allowing the first voltage signal V1 from the second capacitor FD2 to flow to the fourth storage capacitor C4 for storage. In other words, with the second source follower SF2, the second column select signal switch RS2, and the sixth switch S6 all turned on, the fourth storage capacitor C4 is used to store the first voltage signal V1.
[0101] Thirdly, by turning on the third switch S3 and the fourth switch S4, the first voltage signal V1 stored in the first storage capacitor C1 and the second voltage signal V2 stored in the second storage capacitor C2 are released to the first and second terminals of the first differential amplifier U1, respectively. The first differential amplifier U1 performs differential processing on the first voltage signal V1 and the second voltage signal V2, and outputs the first differential voltage signal |V1-V2| and the first polarity signal P1. The first differential voltage signal |V1-V2| is output to the first analog-to-digital converter 310 for data acquisition, and the first polarity signal P1 is output to the image processing unit 400.
[0102] It should be noted that the data acquired by the first analog-to-digital converter 310 is not the voltage amplitude of the first voltage signal V1, but the voltage amplitude of the first differential voltage signal |V1-V2|. Since the voltage amplitude of the first differential voltage signal |V1-V2| is smaller than the voltage amplitude of the first voltage signal V1, the time spent acquiring the voltage amplitude of the first differential voltage signal |V1-V2| is shorter than that spent by the first analog-to-digital converter 310 directly acquiring the voltage amplitude of the first voltage signal V1, thus saving the readout time (i.e., acquisition time) of the first analog-to-digital converter 310 and improving the readout speed of the first pixel circuit 110.
[0103] Taking the case where the first polarity signal P1 is "0" to indicate that the voltage amplitude of the first voltage signal V1 is less than the voltage amplitude of the second voltage signal V2, and the first polarity signal P1 is "1" to indicate that the voltage amplitude of the first voltage signal V1 is greater than the voltage amplitude of the second voltage signal V2, as an example.
[0104] When the first analog-to-digital converter 310 outputs 100 LSB based on the first differential voltage signal |V1-V2|, and the second digital-to-analog converter 320 outputs 500 LSB based on the second voltage signal V2, if the first polarity signal P1 is "1", the actual data output by the first analog-to-digital converter based on the input first voltage signal V1 in related technologies is 600 LSB; if the first polarity signal P1 is "0", the actual data output by the first analog-to-digital converter 310 based on the input first voltage signal V1 in related technologies is 400 LSB. However, in this embodiment, the first analog-to-digital converter 310 outputs 100 LSB based on the input first differential voltage signal |V1-V2|. Compared with the time spent by the first analog-to-digital converter 310 directly acquiring the voltage amplitude of the first voltage signal V1, the first analog-to-digital converter 310 spends less time acquiring the first differential voltage signal |V1-V2|, thus saving the readout time of the first analog-to-digital converter 310.
[0105] Ideally, the voltage amplitude of the first voltage signal V1 is equal to the voltage amplitude of the second voltage signal V2, and the voltage amplitude of the first differential voltage signal |V1-V2| is the smallest. In this case, the first analog-to-digital converter 310 takes the least time to acquire the first differential voltage signal |V1-V2|, and the first analog-to-digital converter 310 has the lowest readout time, which greatly saves the readout time of the first analog-to-digital converter 310.
[0106] It should be noted that the read time of the analog-to-digital converter is determined by the voltage magnitude of the pixel data; the larger the voltage amplitude of the pixel data, the longer the read time. For example... Figure 6BAs shown, taking a working clock of 1kHz as an example, if the second voltage signal V2 is 2.3V, the second analog-to-digital converter 320 reads it in 7ms, with a read value of 500LSB. If the first voltage signal V1 is 2.5V, the first analog-to-digital converter directly acquires the first voltage signal V1, with a read time of 10ms and a read value of 600LSB. However, in this embodiment, the first analog-to-digital converter 310 only reads the difference of 0.2V between the first voltage signal V1 and the second voltage signal V2, that is, the voltage amplitude of the first differential voltage signal |V1-V2| is 0.2V. The first analog-to-digital converter 310 reads the 0.2V data of the first differential voltage signal |V1-V2| in 4ms, with a read value of 100LSB, saving 6ms of read time. Subsequently, the image processing unit 400, in conjunction with the first polarity signal P1, can recover the original value of the first voltage signal V1, 600LSB.
[0107] In this way, compared with the time spent by the first analog-to-digital converter 310 directly acquiring data from the first voltage signal V1, the first analog-to-digital converter 310 spends less time acquiring the first differential voltage signal |V1-V2|, thereby effectively improving the acquisition speed of the first analog-to-digital converter 310.
[0108] Meanwhile, since the embodiments of this application improve the single acquisition speed of pixel data by the first analog-to-digital converter 310, the first analog-to-digital converter 310 acquires more pixel data in the same time period, thereby acquiring more data for averaging calculation and effectively improving the data acquisition accuracy of the first analog-to-digital converter 310.
[0109] In addition, such as Figure 6A As shown, in the image sensor 10 provided in this application embodiment, the third pixel circuit 130 may include a fifth photoelectric conversion element PD5, a sixth photoelectric conversion element PD6, a fifth transfer transistor TG5, a sixth transfer transistor TG6, a third capacitor FD3, a third reset transistor RST3, a third source follower SF3, and a third column select signal switch RS3.
[0110] Regarding the third pixel circuit 130, ignoring the reset signal readout step and focusing on the photosensitive signal readout step, the workflow of the third pixel circuit 130 may include: The first step involves exposing the fifth photoelectric conversion element PD5. Under the excitation of incident light, the fifth photoelectric conversion element PD5 generates photosensitive electrons, which accumulate within the potential hydrazine.
[0111] The second step involves charge transfer and photosensitive signal readout from the fifth photoelectric conversion element PD5. Activating the fifth transfer transistor TG5 transfers the charge of photosensitive electrons generated by the fifth photoelectric conversion element PD5 from the photosensitive region to the n+ region of the third capacitor FD3. At this time, the voltage signal of the third capacitor FD3 is the photosensitive signal, i.e., the third voltage signal V3. In this case, by turning on the third source follower SF3, the third column select signal switch RS3, and the fifth switch S5, the third voltage signal V3 in the third capacitor FD3 is transferred to the third storage capacitor C3 for storage. In other words, when the third source follower SF3, the third column select signal switch RS3, and the fifth switch S5 are all turned on, the third storage capacitor C3 is used to store the third voltage signal V3.
[0112] Thirdly, by turning on the seventh switch S7 and the eighth switch S8, the third voltage signal V3 stored in the third storage capacitor C3 and the first voltage signal V1 stored in the fourth storage capacitor C4 are released to the first and second terminals of the second differential amplifier U2, respectively. The second differential amplifier U2 performs differential processing on the third voltage signal V3 and the first voltage signal V1, and outputs the second differential voltage signal |V3-V1| and the second polarity signal P2. The second differential voltage signal |V3-V1| is output to the third analog-to-digital converter 330 for data acquisition, and the second polarity signal P2 is output to the image processing unit 400.
[0113] It should be noted that the data acquired by the third analog-to-digital converter 330 is not the voltage amplitude of the third voltage signal V3, but the voltage amplitude of the second differential voltage signal |V3-V1|. Since the voltage amplitude of the second differential voltage signal |V3-V1| is smaller than that of the third voltage signal V3, the time spent acquiring the voltage amplitude of the second differential voltage signal |V3-V1| is shorter than that spent by the third analog-to-digital converter 330 directly acquiring the voltage amplitude of the third voltage signal V3. This saves the readout time (i.e., acquisition time) of the third analog-to-digital converter 330 and improves the readout speed of the third pixel circuit 130.
[0114] Taking the case where the second polarity signal P2 is "0" to indicate that the voltage amplitude of the third voltage signal V3 is less than the voltage amplitude of the first voltage signal V1, and the second polarity signal P2 is "1" to indicate that the voltage amplitude of the third voltage signal V3 is greater than the voltage amplitude of the first voltage signal V1, as an example.
[0115] If, in this embodiment of the application, the third analog-to-digital converter 330 outputs 100 LSB based on the second differential voltage signal |V3-V1|, the second digital-to-analog converter 320 outputs 500 LSB based on the second voltage signal V2, and the first analog-to-digital converter 310 outputs 100 LSB based on the first differential voltage signal |V1-V2|, and if both the first polarity signal P1 and the second polarity signal P2 are "1", in related technologies, the actual data output by the first analog-to-digital converter based on the first voltage signal V1 is 600 LSB, and the actual data output by the third analog-to-digital converter based on the first voltage signal V1 is 700 LSB; if both the first polarity signal P1 and the second polarity signal P2 are "1", the actual data output by the first analog-to-digital converter based on the first voltage signal V1 is 600 LSB, and the actual data output by the third analog-to-digital converter based on the first voltage signal V1 is 700 LSB; if the first polarity signal P1 and the second polarity signal P2 are both "1", the actual data output by the first analog-to-digital converter based on the first voltage signal V1 is 600 LSB, and the actual data output by the third analog-to-digital converter based on the first voltage signal V1 is 700 LSB; if both the first polarity signal P1 and the second polarity signal P2 are "1", the actual data output by the first analog-to-digital converter based on the first voltage signal V1 is 600 LSB, and the actual data output by the third analog-to-digital converter based on the first voltage signal V1 is 700 LSB. Signal P2 is always "0". In related technologies, the actual data output by the first analog-to-digital converter 310 based on the first voltage signal V1 is 400 LSB, and the actual data output by the third analog-to-digital converter based on the first voltage signal V1 is 300 LSB. However, in this embodiment, the data output by the first analog-to-digital converter 310 based on the first differential voltage signal |V1-V2| is 100 LSB. Compared with the time spent by the first analog-to-digital converter 310 to output 600 LSB or 400 LSB based on the first voltage signal V1, the first analog-to-digital converter 310 spends less time acquiring the first differential voltage signal |V1-V2|, thus saving the readout time of the first analog-to-digital converter 310. Meanwhile, the third analog-to-digital converter 330 outputs 100 LSB of data based on the second differential voltage signal |V3-V1|. Compared to the time it takes for the third analog-to-digital converter 330 to output 700 LSB or 300 LSB of data based on the third voltage signal V3, the third analog-to-digital converter 330 spends less time acquiring the second differential voltage signal |V3-V1|, thus saving the readout time of the third analog-to-digital converter 330. Ideally, the voltage amplitude of the third voltage signal V3 is equal to that of the first voltage signal V1, and the voltage amplitude of the second differential voltage signal |V3-V1| is minimized. In this case, the third analog-to-digital converter 330 takes the least time to acquire the second differential voltage signal |V3-V1|, and the readout time of the third analog-to-digital converter 330 is minimized, thus significantly saving the readout time of the third analog-to-digital converter 330.
[0116] In this way, compared with the time spent by the third analog-to-digital converter 330 directly acquiring data from the third voltage signal V3, the acquisition time spent by the third analog-to-digital converter 330 acquiring the second differential voltage signal |V3-V1| is less, thereby effectively improving the acquisition speed of the third analog-to-digital converter 330.
[0117] Meanwhile, since the embodiments of this application improve the single acquisition speed of pixel data by the third analog-to-digital converter 330, the third analog-to-digital converter 330 acquires more pixel data in the same time period, thereby acquiring more data for averaging calculation and effectively improving the acquisition accuracy of the third analog-to-digital converter 330.
[0118] In some embodiments of this application, in order to enable the image sensor 10 to perform both image imaging function and multispectral imaging function through multispectral recognition, such as Figure 7 As shown, the image sensor 10 provided in this application embodiment may include a pixel array 100, the pixel array 100 including at least one multispectral unit 140; the multispectral unit 140 includes at least one first type pixel 101 for multispectral imaging and at least two second type pixels 102 for image imaging.
[0119] The image sensor 10 provided in this embodiment may further include a color filter array 500. The color filter array 500 includes filter units 510 disposed opposite to the multispectral unit 140. The filter unit 510 includes at least one first-type filter element 501 and at least two second-type filter elements 502. The first-type filter element 501 is disposed opposite to the first-type pixel 101; the second-type filter element 502 is disposed opposite to the second-type pixel 102; the first-type filter element 501 and the second-type filter element 502 can transmit light wavelength ranges that are different.
[0120] Thus, the image sensor 10 recognizes multispectral information through the color channel corresponding to the first type of filter element 501 to achieve multispectral imaging, and achieves image imaging through the color channel corresponding to the second type of filter element 502. This allows the image sensor 10 to perform both image imaging function and multispectral imaging function through multispectral recognition, eliminating the need for an additional multispectral sensor to recognize multispectral information and reducing hardware power consumption.
[0121] In some embodiments of this application, in order to further improve the acquisition speed and accuracy of pixel data for multispectral imaging, such as Figure 7 As shown, the first type of pixel 101 in the multispectral unit 140 includes a first pixel circuit 110. In other words, the first pixel circuit 110 can belong to the first type of pixel 101 in the multispectral unit 140.
[0122] In addition, the first type of pixel 101 in the multispectral unit 140 may also include a second pixel circuit 120 and a third pixel circuit 130.
[0123] like Figure 7As shown, the second pixel circuit 120 and the first pixel circuit 110 can be two first-class pixels 101 in the same column of the multispectral unit 140. The first pixel circuit 110 and the third pixel circuit 130 can be two first-class pixels 101 in the same row of the multispectral unit 140.
[0124] Thus, since the first pixel circuit 110 is a first type of pixel 101 used for multispectral imaging, the first analog-to-digital converter 310 corresponding to the first pixel circuit 110 can be applied to the scenario of acquiring multispectral pixel data. In this way, compared to the first analog-to-digital converter 310 directly acquiring multispectral pixel data from the first pixel circuit 110, the first analog-to-digital converter 310 spends less time acquiring the first differential voltage signal |V1-V2|, thereby effectively improving the acquisition speed of multispectral pixel data by the first analog-to-digital converter 310. Simultaneously, since this embodiment improves the single acquisition speed of multispectral pixel data by the first analog-to-digital converter 310, the total number of acquisitions of multispectral pixel data by the first analog-to-digital converter 310 is greater within the same time period, thereby enabling the acquisition of more multispectral pixel data for averaging calculation, effectively improving the acquisition accuracy of multispectral pixel data by the first analog-to-digital converter 310.
[0125] Similarly, when the third pixel circuit 130 belongs to the first type of pixel 101 used for multispectral imaging, it can also effectively improve the acquisition speed and accuracy of multispectral pixel data by the third analog-to-digital converter 330 corresponding to the third pixel circuit 130.
[0126] Of course, in other embodiments, the second pixel circuit 120 and the first pixel circuit 110 may also be two first-type pixels 101 in the same row of the multispectral unit 140. Alternatively, the second pixel circuit 120 and the first pixel circuit 110 may also be two first-type pixels 101 in different columns and rows of the multispectral unit 140. Alternatively, the first pixel circuit 110 and the third pixel circuit 130 may also be two first-type pixels 101 in the same column of the multispectral unit 140. Alternatively, the first pixel circuit 110 and the third pixel circuit 130 may also be two first-type pixels 101 in different columns and rows of the multispectral unit 140. This application does not impose specific limitations on the relative positions of the first pixel circuit 110 and the second pixel circuit 120, or the relative positions of the first pixel circuit 110 and the third pixel circuit 130.
[0127] In this embodiment, the first analog-to-digital converter 310 corresponding to the first pixel circuit 110 is used to acquire multispectral pixel data. Furthermore, the third analog-to-digital converter 330 corresponding to the third pixel circuit 130 can also be used to acquire multispectral pixel data. In this application scenario, the acquisition and reading speed of the first type of pixels 101 used for multispectral imaging is significantly improved by utilizing the first and third analog-to-digital converters 310 and 330. Moreover, because the acquisition speed of multispectral pixel data by the first and third analog-to-digital converters 310 and 330 is accelerated, they can acquire a larger number of multispectral pixel data for averaging calculation within the same time frame, further improving the acquisition accuracy of the multispectral pixel data. Given that the first and third analog-to-digital converters 310 and 330 can acquire multispectral pixel data faster and in greater quantities, the image sensor 10 can achieve better imaging results in various scenarios such as complex colors and low light sources.
[0128] Of course, in other embodiments of this application, the first pixel circuit 110 may also correspond to the second type of pixel 102 in the multispectral unit 140, the second pixel circuit 120 may also correspond to the second type of pixel 102 in the multispectral unit 140, and the third pixel circuit 130 may also correspond to the second type of pixel 102 in the multispectral unit 140. This application does not impose any specific limitations on this.
[0129] In some embodiments of this application, in order to balance the data acquisition volume of different types of pixels in the pixel array, embodiments of this application can increase the acquisition speed of the type of pixels with a smaller proportion of numbers. For example, such as Figure 7 As shown, in a multispectral unit 140, the proportion of the number of first-type pixels 101 is less than the proportion of the number of second-type pixels 102; The proportion of the first type of pixels 101 is the ratio of the number of first type pixels to the total number of pixels in the multispectral unit, and the proportion of the second type of pixels 102 is the ratio of the number of second type pixels to the total number of pixels in the multispectral unit.
[0130] For example, the proportion of the first type of pixels 101 is in the range of 1% to 50% to avoid the multispectral channel density range being too large and occupying too much of the color channel of the second type of pixels, thus affecting the image quality generated based on the second type of pixels.
[0131] In this way, for the first type of pixels 101, which account for a smaller proportion, such as the first pixel circuit 110 and the third pixel circuit 130, the data acquisition speed is faster, thereby acquiring more data in the same amount of time, improving the acquisition speed of the first type of pixels 101, which account for a smaller proportion, and balancing the amount of data acquired by different types of pixels in the pixel array.
[0132] In addition, such as Figure 8 As shown, this application embodiment also provides a camera module 800, including the image sensor 10 provided in any of the above embodiments.
[0133] The camera module 800 may also include a lens 20, a drive module 30, a filter module 40, a base 50, adhesive 60, and a circuit board 70. The image sensor 10 is attached to the circuit board 70 using adhesive 60.
[0134] In the camera module provided in this application embodiment, by setting a first differential circuit in the image sensor, the first differential circuit can perform differential processing on the first voltage signal output by the first pixel circuit and the second voltage signal output by the second pixel circuit to obtain a first differential voltage signal. Then, the first analog-to-digital converter obtains the voltage amplitude of the first differential voltage signal based on the first differential voltage signal. Since the time spent by the first analog-to-digital converter to acquire data is positively correlated with the voltage amplitude of the acquired data, the voltage amplitude of the first differential voltage signal is smaller than the voltage amplitude of the first voltage signal. Compared with the time spent by the first analog-to-digital converter to directly acquire data from the first voltage signal, the acquisition time spent by the first analog-to-digital converter to acquire the first differential voltage signal is less, thereby effectively improving the acquisition speed of the first analog-to-digital converter.
[0135] It should be noted that the camera module provided in this application includes the image sensor provided in any of the above embodiments, and can realize all the functions of the image sensor. To avoid repetition, it will not be described again here.
[0136] In addition, such as Figure 9 As shown in the figure, this application embodiment also provides an electronic device 900, such as Figure 9 As shown, the electronic device 900 includes a housing 910 and a camera module 800.
[0137] In the camera module 800, the number of lenses 20 can be set according to actual needs. For example, such as Figure 9 As shown, the camera module 800 is equipped with four lenses. Of course, in practical applications, the number of lenses 20 in the camera module 800 can also be set to one, two, three, or five, etc., according to actual needs. This application does not limit the specific number of lenses 20 in the camera module 800.
[0138] The lens 20 in the camera module 800 can extend from the housing 910 to facilitate image capture.
[0139] It should be noted that the electronic device provided in this application embodiment includes the camera module provided in any of the above embodiments. Since the camera module includes the image sensor provided in any of the above embodiments and can realize all the functions of the image sensor, the electronic device obviously also includes the image sensor provided in any of the above embodiments and can realize all the functions of the image sensor. To avoid repetition, it will not be described again here.
[0140] In the embodiments of this application, the electronic device can be a terminal or other devices besides a terminal. For example, the electronic device can be a smartwatch, mobile phone, tablet computer, laptop computer, PDA, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR), virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), etc. The embodiments of this application do not specifically limit the scope.
[0141] In the description of this specification, the references to terms such as "one embodiment," "some embodiments," "illustrative embodiment," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of this application. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples.
[0142] Although embodiments of this application have been shown and described, those skilled in the art will understand that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of this application, the scope of which is defined by the claims and their equivalents.
Claims
1. An image sensor, characterized by, The image sensor comprises: a first pixel circuit, a second pixel circuit, a first differential circuit and a first analog-to-digital converter; an output end of the first pixel circuit is coupled with a first end of the first differential circuit, an output end of the second pixel circuit is coupled with a second end of the first differential circuit, and a third end of the first differential circuit is connected with the first analog-to-digital converter; the first differential circuit is configured to perform differential processing on a first voltage signal output by the first pixel circuit and a second voltage signal output by the second pixel circuit to obtain a first differential voltage signal; and the first analog-to-digital converter is configured to obtain a voltage amplitude of the first differential voltage signal based on the first differential voltage signal input by the first differential circuit to the first analog-to-digital converter. The voltage amplitude of the first differential voltage signal is less than the voltage amplitude of the first voltage signal.
2. The image sensor of claim 1, wherein, The image sensor further comprises an image processing unit, the first analog-to-digital converter is connected with the image processing unit, and the third end of the first differential circuit is further connected with the image processing unit. The image processing unit is configured to determine the voltage amplitude of the first voltage signal based on a voltage amplitude of the second voltage signal, the voltage amplitude of the first differential voltage signal and a first polarity signal input by the first differential circuit to the image processing unit. The voltage amplitude of the second voltage signal is a known quantity, and the first polarity signal is used to represent the size relationship between the voltage amplitude of the first voltage signal and the voltage amplitude of the second voltage signal.
3. The image sensor of claim 2, wherein, The image sensor further comprises a second analog-to-digital converter, an output end of the second pixel circuit is further connected with the second analog-to-digital converter, and the second analog-to-digital converter is connected with the image processing unit. The second analog-to-digital converter is configured to obtain the voltage amplitude of the second voltage signal based on the second voltage signal input by the second pixel circuit to the second analog-to-digital converter.
4. The image sensor of claim 2, wherein, The image sensor further comprises a third pixel circuit, a second differential circuit and a third analog-to-digital converter. An output end of the third pixel circuit is coupled with a first end of the second differential circuit, an output end of the first pixel circuit is further coupled with a second end of the second differential circuit, and a third end of the second differential circuit is connected with the third analog-to-digital converter. The second differential circuit is configured to perform differential processing on a third voltage signal output by the third pixel circuit and the first voltage signal output by the first pixel circuit to obtain a second differential voltage signal. The third analog-to-digital converter is configured to obtain a voltage amplitude of the second differential voltage signal based on the second differential voltage signal input by the second differential circuit to the third analog-to-digital converter. The voltage amplitude of the second differential voltage signal is less than the voltage amplitude of the third voltage signal.
5. The image sensor of claim 4, wherein, The third end of the second differential circuit is further connected with the image processing unit. The image processing unit is further configured to determine the voltage amplitude of the third voltage signal based on the voltage amplitude of the first voltage signal, the voltage amplitude of the second differential voltage signal and a second polarity signal input by the second differential circuit to the image processing unit. The second polarity signal is used to represent a size relationship between a voltage amplitude of the third voltage signal and a voltage amplitude of the first voltage signal.
6. The image sensor of claim 2, wherein, The image sensor further comprises a first switch and a second switch; a first end of the first switch is connected with an output end of the first pixel circuit, and a second end of the first switch is connected with a first end of the first differential circuit; the first switch is used to turn on the output end of the first pixel circuit and the first end of the first differential circuit; a first end of the second switch is connected with an output end of the second pixel circuit, and a second end of the second switch is connected with a second end of the first differential circuit; the second switch is used to turn on the output end of the second pixel circuit and the second end of the first differential circuit.
7. The image sensor of claim 6, wherein, The first differential circuit comprises a first differential amplifier; a first end of the first differential amplifier is coupled with the second end of the first switch, a second end of the first differential amplifier is coupled with the second end of the second switch, and a third end of the first differential amplifier is connected with the first analog-to-digital converter and the image processing unit respectively; The first differential amplifier is used to: perform differential processing on the first voltage signal and the second voltage signal to obtain a first differential voltage signal and a first polarity signal; output the first differential voltage signal to the first analog-to-digital converter, and output the first polarity signal to the image processing unit.
8. The image sensor of claim 6, wherein, The first differential circuit further comprises a first storage capacitor, a second storage capacitor, a third switch and a fourth switch; a first end of the first storage capacitor is connected with the output end of the first pixel circuit through the first switch; the first end of the first storage capacitor is also connected with the first end of the first differential amplifier through the third switch; and a second end of the first storage capacitor is grounded; a first end of the second storage capacitor is connected with the output end of the second pixel circuit through the second switch; the first end of the second storage capacitor is also connected with the second end of the first differential amplifier through the fourth switch; and a second end of the second storage capacitor is grounded; in a case where the first switch is in a turned-on state, the first storage capacitor is used to store the first voltage signal output by the first pixel circuit; and in a case where the second switch is in a turned-on state, the second storage capacitor is used to store the second voltage signal output by the second pixel circuit; in a case where the third switch and the fourth switch are in a turned-on state, the first storage capacitor and the second storage capacitor are in a discharging state, and the first differential amplifier is used to perform differential processing on a first signal and a second signal to obtain a first differential voltage signal and a first polarity signal; the first signal is the first voltage signal discharged by the first storage capacitor in the discharging state, and the second signal is the second voltage signal discharged by the second storage capacitor in the discharging state.
9. The image sensor of claim 4, wherein, The image sensor further comprises a fifth switch and a sixth switch; A first end of the fifth switch is connected with an output end of the third pixel circuit, and a second end of the fifth switch is connected with a first end of the second differential circuit; the fifth switch is used for conducting the output end of the third pixel circuit and the first end of the second differential circuit; A first end of the sixth switch is connected with an output end of the first pixel circuit, and a second end of the sixth switch is connected with a second end of the second differential circuit; the sixth switch is used for conducting the output end of the first pixel circuit and the second end of the second differential circuit.
10. The image sensor of claim 9, wherein, The second differential circuit comprises a second differential amplifier; a first end of the second differential amplifier is coupled with the second end of the fifth switch, a second end of the second differential amplifier is coupled with the second end of the sixth switch, and a third end of the second differential amplifier is connected with the third analog-to-digital converter and the image processing unit respectively; The second differential amplifier is configured to: perform differential processing on the third voltage signal and the first voltage signal to obtain a second differential voltage signal and a second polarity signal; output the second differential voltage signal to the third analog-to-digital converter, and output the second polarity signal to the image processing unit.
11. The image sensor of claim 10, wherein, The second differential circuit further comprises a seventh switch, an eighth switch, a third storage capacitor and a fourth storage capacitor; A first end of the third storage capacitor is connected with the output end of the third pixel circuit through the fifth switch, and the first end of the third storage capacitor is also connected with the first end of the second differential amplifier through the seventh switch; and a second end of the third storage capacitor is grounded. A first end of the fourth storage capacitor is connected with the output end of the first pixel circuit through the sixth switch; the first end of the fourth storage capacitor is also connected with the second end of the second differential amplifier through the eighth switch; and a second end of the fourth storage capacitor is grounded. The third end of the second differential amplifier is connected with the third analog-to-digital converter and the image processing unit respectively; When the fifth switch is in a conducting state, the third storage capacitor is configured to store the third voltage signal output by the third pixel circuit; When the sixth switch is in a conducting state, the fourth storage capacitor is configured to store the first voltage signal output by the first pixel circuit; When the seventh switch and the eighth switch are in a conducting state, the third storage capacitor and the fourth storage capacitor are in a discharging state, and the second differential amplifier is configured to perform differential processing on a third signal and a fourth signal to obtain a second differential voltage signal and a second polarity signal; The third signal is the third voltage signal discharged by the third storage capacitor in the discharging state, and the fourth signal is the first voltage signal discharged by the second storage capacitor in the discharging state.
12. The image sensor according to any one of claims 1 to 11, characterized by, The image sensor comprises a pixel array, and the pixel array comprises at least one multi-spectral unit; The multi-spectral unit comprises at least one first type of pixel for multi-spectral imaging and at least two second type of pixels for image imaging; The multi-spectral unit comprises at least one first type of pixel for multi-spectral imaging and at least two second type of pixels for image imaging; The first type of pixels in the multi-spectrum unit include the first pixel circuit.
13. The image sensor of claim 12, wherein, In one multi-spectrum unit, the number of the first type of pixels accounts for less than the number of the second type of pixels. The number of the first type of pixels accounts for the ratio of the number of the first type of pixels to the total number of pixels in the multi-spectrum unit, and the number of the second type of pixels accounts for the ratio of the number of the second type of pixels to the total number of pixels in the multi-spectrum unit.
14. An image capture module, comprising: The image sensor of any one of claims 1-13.
15. An electronic device, comprising: The camera module of claim 14.