Analog-to-digital conversion circuit, analog-to-digital conversion method, image sensor, camera module and equipment
By designing an adaptive analog-to-digital conversion circuit in the CMOS image sensor, adjusting the sampling signal according to the pixel voltage size, the noise problem of the CMOS image sensor in medium and high-bright scenes is solved, and the output frame rate and image quality of the image sensor are improved.
Patent Information
- Application Number
- CN202411121041.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-15
- Publication Date
- 2024-12-03
AI Technical Summary
CMOS image sensors are disturbed by noise during imaging, especially in medium and high-bright scenes, photon shot noise dominates. The existing multiple related sampling technology results in waste of resources and increased power consumption when used on all scenarios and pixels, limiting the Output frame rate.
An analog-to-digital conversion circuit is designed, including a ramp signal generation module, a signal selection module, a feedback module, a comparator and a counter. The sampled ramp signal is adaptively adjusted according to the pixel voltage magnitude. If the voltage is less than the reference voltage, the first ramp signal is output. , if the voltage is greater than the reference voltage, the maximum value of the first ramp signal and the second ramp signal is output to realize adaptive correlation sampling of different pixel voltages.
While improving image quality, it avoids resource waste and power consumption, ensures image output frame rate, and improves user experience in preview and video modes.
Smart Images

Figure CN119071658A_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of camera technology, and specifically relates to an analog-to-digital conversion circuit, method, image sensor, camera module and equipment. Background Art
[0002] Image sensors are the core components of camera compact modules (CCM). Image sensors are mostly divided into two types: one is a charge-coupled device (CCD) component; the other is a complementary metal-oxide-semiconductor (CMOS) device. Among them, CMOS image sensors (CIS) are widely used due to their low cost and power consumption, and more flexible reading methods.
[0003] CMOS image sensors are inevitably affected by noise during the imaging process. More and more CIS use correlated multiple sampling (CMS) technology to reduce readout noise. However, this method is only applicable to dark light scenes or dark areas of high dynamic range (HDR) scenes where readout noise dominates. It is not applicable to medium and high light scenes where photon shot noise dominates. If multiple correlated sampling is performed on all pixels in all scenes, it will cause a waste of resources and limit the output frame rate of the CIS. Summary of the invention
[0004] The purpose of the embodiments of the present application is to provide an analog-to-digital conversion circuit, method, image sensor, camera module and device that can improve image quality without reducing the output frame rate of the image.
[0005] In a first aspect, an embodiment of the present application provides an analog-to-digital conversion circuit, comprising a ramp signal generating module, a signal selecting module, a feedback module, a comparator and a counter; a first end of the signal selecting module is connected to the ramp signal generating module, the ramp signal generating module is used to output a first ramp signal or a second ramp signal, and the slope corresponding to the first ramp signal and the slope corresponding to the second ramp signal are opposite to each other; a first end of the feedback module is connected to a control end of the signal selecting module, the feedback module is used to control the on and off of the signal selecting module, and a second end of the feedback module is connected to a first output end of the comparator; a first input end of the comparator is connected to a second end of the signal selecting module, the second input end of the comparator is used to receive a pixel signal, and the comparator is used to compare the pixel voltage corresponding to the pixel signal with a reference voltage; the counter is connected to a second output end of the comparator, and the counter is used to output a digital signal corresponding to the pixel signal;
[0006] When the pixel signal is subjected to analog-to-digital conversion by the analog-to-digital conversion circuit, if the pixel voltage corresponding to the pixel signal is less than the reference voltage, the signal selection module is controlled to be turned on by the feedback module to output the first ramp signal for sampling; if the pixel voltage corresponding to the pixel signal is greater than the reference voltage, the signal selection module is controlled to be turned on by the feedback module to output the maximum value of the first ramp signal and the second ramp signal for sampling.
[0007] In a second aspect, an embodiment of the present application provides an analog-to-digital conversion method, which is applied to the analog-to-digital conversion circuit described in the first aspect above, and the method includes: outputting a first ramp signal or a second ramp signal through a ramp signal generating module, and the slope corresponding to the first ramp signal and the slope corresponding to the second ramp signal are opposite to each other; controlling a signal selection module through a feedback module to output the first ramp signal, or the maximum value of the first ramp signal and the second ramp signal; acquiring a pixel signal through a comparator, and when the analog-to-digital conversion circuit performs analog-to-digital conversion on the pixel signal, if the pixel voltage corresponding to the pixel signal is less than a reference voltage, sampling is performed through the first ramp signal; if the pixel voltage corresponding to the pixel signal is greater than the reference voltage, sampling is performed through the maximum value of the first ramp signal and the second ramp signal; and outputting a digital signal corresponding to the pixel signal through a counter.
[0008] In a third aspect, an embodiment of the present application provides an image sensor, comprising a pixel array, an analog-to-digital conversion circuit as described in the first aspect above, and an image signal processor; the pixel array comprises a plurality of target pixels, and output ends of the target pixels in the same column are electrically connected to the analog-to-digital conversion circuit; the analog-to-digital conversion circuit is used to perform analog-to-digital conversion on pixel signals of the target pixels to obtain digital signals corresponding to the pixel signals; the image signal processor is used to process the digital signals to obtain a processed image.
[0009] In a fourth aspect, an embodiment of the present application provides a camera module, comprising an image sensor, wherein the image sensor uses the analog-to-digital conversion circuit described in the first aspect to perform analog-to-digital conversion, or uses the analog-to-digital conversion method described in the second aspect to perform analog-to-digital conversion.
[0010] In a fifth aspect, an embodiment of the present application provides an electronic device, comprising the camera module as described in the fourth aspect above.
[0011] In the sixth aspect, an embodiment of the present application provides an analog-to-digital conversion device, including: a signal generating module, used to output a first ramp signal or a second ramp signal, the slope corresponding to the first ramp signal and the slope corresponding to the second ramp signal are opposite to each other; a control module, used to control the selection module to output the first ramp signal, or the maximum value of the first ramp signal and the second ramp signal; a comparison module, used to obtain a pixel signal, when the analog-to-digital conversion circuit performs analog-to-digital conversion on the pixel signal, if the pixel voltage corresponding to the pixel signal is less than the reference voltage, sampling is performed through the first ramp signal; if the pixel voltage corresponding to the pixel signal is greater than the reference voltage, sampling is performed through the maximum value of the first ramp signal and the second ramp signal; a counting module, used to output a digital signal corresponding to the pixel signal.
[0012] In the seventh aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the second aspect are implemented.
[0013] In an eighth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the second aspect are implemented.
[0014] In the ninth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the second aspect.
[0015] In a tenth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the second aspect.
[0016] In an embodiment of the present application, the analog-to-digital conversion circuit includes a ramp signal generating module, a signal selecting module, a feedback module, a comparator and a counter; when the analog-to-digital conversion circuit performs analog-to-digital conversion on the pixel signal, if the pixel voltage corresponding to the pixel signal is less than the reference voltage, the signal selecting module is turned on by the feedback module to output the first ramp signal for sampling; if the pixel voltage corresponding to the pixel signal is greater than the reference voltage, the signal selecting module is turned on by the feedback module to output the maximum value of the first ramp signal and the second ramp signal for sampling. In this way, the ramp signal used for sampling can be adaptively adjusted according to the size of the pixel voltage, so that different pixel voltages have different related sampling times, thereby avoiding resource waste and saving power consumption. In addition, the slope corresponding to the first ramp signal and the slope corresponding to the second ramp signal are opposite to each other. When the pixel voltage is greater than the reference voltage, the maximum value of the first ramp signal and the second ramp signal is used for sampling, and the number of related sampling is increased without significantly increasing the additional quantization time, so that the image quality can be improved without reducing the output frame rate of the image, which is conducive to improving the user experience in preview, recording and other modes.
[0017] Additional aspects and advantages of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] The above and / or additional aspects and advantages of the present invention will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:
[0019] Figure 1 It is a structural schematic diagram of an analog-to-digital conversion circuit in the related art;
[0020] Figure 2 yes Figure 1 Working timing diagram of analog-to-digital conversion circuit;
[0021] Figure 3 is a structural schematic diagram of an analog-to-digital conversion circuit provided in an embodiment of the present application;
[0022] Figure 4 yes Figure 3 The structural diagram of the feedback module;
[0023] Figure 5 yes Figure 3 The structural diagram of the signal selection module;
[0024] Figure 6 This is a working timing diagram of 2-time correlated multi-sampling under medium and high illumination provided by an embodiment of the present application;
[0025] Figure 7 This is a working timing diagram of 4-time correlated multi-sampling under low illumination provided by an embodiment of the present application;
[0026] Figure 8 It is a flowchart of the analog-to-digital conversion method provided in an embodiment of the present application;
[0027] Fig. 9 is a schematic diagram of the structure of an image sensor provided in an embodiment of the present application;
[0028] Fig.10 yes Fig. 9 Schematic diagram of the circuit structure of the pixel;
[0029] Fig.11 is a structural schematic diagram of an analog-to-digital conversion device provided in an embodiment of the present application;
[0030] Fig.12 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application;
[0031] Fig.13 It is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application.
[0032] Reference numerals:
[0033] 310- ramp signal generating module; 320- signal selecting module; 321- first operational amplifier; 322- first diode; 323- second operational amplifier; 324- second diode; 325- control switch; 330- feedback module; 331- AND gate circuit; 332- trigger; 340- comparator; 350- counter; 1110- signal generating module; 1120- control module; 1130- selecting module; 1140- comparing module; 1150- counting module. DETAILED DESCRIPTION
[0034] Embodiments of the present invention will be described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and should not be construed as limiting the present invention. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.
[0035] The terms "first", "second", etc. in the specification of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.
[0036] In recent years, camera modules have become standard modules for smartphones, tablets and other terminal devices, and are important tools for obtaining visual information and creating art. Thanks to the portability and computing power advantages of terminal devices, users' demand for images continues to increase, and the imaging quality and shooting functions of various terminal devices are further enhanced. The quality of imaging solutions has become the core competitiveness of various terminal devices.
[0037] The camera module is usually composed of a lens, an infrared cut filter, an image sensor, and a voice coil motor (VCM). The image sensor is the core component of the camera module. Image sensors include CCD devices and CMOS devices. Similar to the film of a traditional camera, the core function of the image sensor is to sense light, that is, to convert the detected light signal into a digital signal that is easy to transmit and process.
[0038] At present, the most widely used in the industry is the CMOS image sensor. Compared with CCD devices, CMOS has lower cost and power consumption, and more flexible reading methods. The working mechanism of CMOS image sensors is as follows: through the array of photosensitive diodes (pixels), light signals are sensed and converted into electrical signals, which are then formed into a digital signal matrix (i.e., image) through the amplification circuit and analog-to-digital conversion (ADC) circuit, and then processed by the image signal processor (ISP) module and compressed and stored.
[0039] CMOS image sensors are inevitably affected by noise during the imaging process. The noise types can be divided into fixed pattern noise (FPN) and temporal noise (TN). FPN is spatial noise, which is manifested as differences in pixel responses at different locations. It is called "fixed" pattern noise because FPN is fixed for a single pixel and does not change with the image frame. FPN can be further divided into pixel FPN, row FPN, and column FPN. Temporal noise is also called random noise, which is a random function of time and changes with the image frame. Read noise (RN) is the main random noise in dark light scenes and obeys Gaussian distribution; photon shot noise is dominant in medium and high light environments and obeys Poisson distribution.
[0040] In order to reduce the readout noise during the imaging process, more and more CMOS image sensors use multiple correlation sampling technology. Figure 1 1 is a schematic diagram of the structure of an analog-to-digital conversion circuit in the related art. As shown in the figure, the conventional analog-to-digital conversion circuit includes a ramp signal generator 110, a comparator 120 and a counter 130; the ramp signal generator 110 is used to generate a ramp signal; the comparator 120 is used to compare the voltage V of the ramp signal ramp and pixel voltage V pixel The counter 130 is used to determine the exposure digital signal of the pixel according to the comparison result under the action of the clock signal. Since the readout noise is essentially a time domain noise that obeys the Gaussian distribution, the readout noise can be effectively reduced by calculating the average value of multiple frames of images collected at different times:
[0041]
[0042] Where n is the readout noise of a single frame image, M is the number of image frames collected, and n avg is the averaged readout noise.
[0043] From the above formula, we can know that the read noise n avg It decreases with the increase of sampling number M. Figure 2The figure shows the working sequence of an ADC that performs 4 multi-correlation samplings. It is not difficult to see that since the CMS technology needs to sample the signal multiple times, the signal readout time will be significantly increased, which will limit the frame rate of the image and increase the power consumption level of the CIS. In addition, the role of the CMS technology is to reduce the readout noise (the readout noise approximately obeys the Gaussian distribution and dominates in dark environments), but it does not work on the photon shot noise (the photon shot noise obeys the Poisson distribution and dominates in medium and high brightness scenes). Therefore, the image quality benefits of this technology are mainly reflected in dark light scenes or dark areas of HDR scenes. If all pixels in all scenes are sampled multiple times, it will cause a waste of resources and increase system power consumption. In addition, the CMS technology based on multiple ADCs will also increase the area of the readout circuit, increase the manufacturing difficulty and cost. Therefore, how to balance the contradiction between image quality and power consumption and manufacturing cost has become one of the problems that need to be solved urgently.
[0044] Combine the following Figure 3-Figure 7 An analog-to-digital conversion circuit according to an embodiment of the present invention is described.
[0045] like Figure 3 As shown, the analog-to-digital conversion circuit of some embodiments of the present invention includes a ramp signal generating module 310, a signal selecting module 320, a feedback module 330, a comparator 340 and a counter 350;
[0046] The first end of the signal selection module 320 is connected to the ramp signal generation module 310, and the ramp signal generation module 310 is used to output a first ramp signal or a second ramp signal, and the slope corresponding to the first ramp signal and the slope corresponding to the second ramp signal are opposite numbers to each other;
[0047] A first end of the feedback module 330 is connected to a control end of the signal selection module 320 , and the feedback module 330 is used to control the on and off of the signal selection module 320 . A second end of the feedback module 330 is connected to a first output end of the comparator 340 .
[0048] A first input terminal of the comparator 340 is connected to a second terminal of the signal selection module 320, a second input terminal of the comparator 340 is used to receive a pixel signal, and the comparator 340 is used to compare a pixel voltage corresponding to the pixel signal with a reference voltage;
[0049] The counter 350 is connected to the second output terminal of the comparator 340, and the counter 350 is used to output a digital signal corresponding to the pixel signal;
[0050] When the pixel signal is converted into digital form through the analog-to-digital conversion circuit, if the pixel voltage corresponding to the pixel signal is less than the reference voltage, the signal selection module 320 is controlled to be turned on through the feedback module 330 to output the first ramp signal for sampling; if the pixel voltage corresponding to the pixel signal is greater than the reference voltage, the signal selection module 320 is controlled to be turned on through the feedback module 330 to output the maximum value of the first ramp signal and the second ramp signal for sampling.
[0051] In an exemplary embodiment, the working mechanism of the analog-to-digital conversion circuit can be divided into a reset signal sampling phase, a comparison phase, and an exposure signal sampling phase:
[0052] 1) Reset signal sampling stage: used to quantize the reset signal from the pixel. The function of this stage is to sample the reset signal multiple times as the basis for subsequent signals;
[0053] 2) Comparison stage: The ramp signal generating module 310 generates a ramp signal with a certain slope, which is input to the negative terminal of the comparator 340. The output signal of the comparator 340 is used to determine the size of the pixel voltage (light intensity) at this time, thereby determining the input method and sampling times of the ramp signal;
[0054] 3) Exposure signal sampling stage: quantize the exposure signal of the pixel according to the sampling method determined in the comparison stage to obtain the final digital signal.
[0055] The comparison stage is the key to realize adaptive correlated multi-sampling. After completing the quantization sampling of the reset signal, the ramp signal generator 310 can be used to output the reference voltage V ref , here, the reference voltage V ref It is used to determine the illumination level of the pixel. For different image sensors, the value of the reference voltage can be determined according to the photosensitivity and noise level of the image sensor.
[0056] Considering the pixel voltage V corresponding to the pixel signal pixel Before entering the analog-to-digital conversion circuit, it needs to be pre-amplified by an operational amplifier. During the amplification, the signal will be inverted. After the large voltage is inverted, the value will be lower. Therefore, when the pixel voltage corresponding to the pixel signal is greater than the reference voltage, that is, V pixel >V ref When , it can be determined that the input voltage of the analog-to-digital conversion circuit ADC is small. At this time, the pixel pixel is in a low illumination state, and the comparison result output by the comparator 340 is a low level, that is, Comp_out=0; on the contrary, when the pixel voltage corresponding to the pixel signal is less than the reference voltage, that is, V pixel <V ref, it can be determined that the input voltage of the ADC is relatively large. At this time, the pixel pixel is in a relatively high illumination state, and the comparison result output by the comparator 340 is a high level, that is, Comp_out=1.
[0057] When the pixel signal is converted into analog-to-digital through the analog-to-digital conversion circuit, when the reference voltage V ref The value of the pixel voltage V pixel hours, indicating that the light is dim at this time, the effective signal level is low, which means that the readout noise accounts for a high proportion, and more sampling is needed to improve the signal-to-noise ratio. At this time, the feedback module 330 can be used to control the signal selection module 320 to be turned on to output the maximum value of the first ramp signal and the second ramp signal for sampling. Since the slope corresponding to the first ramp signal and the slope corresponding to the second ramp signal are opposite to each other, this method can increase the number of related multi-sampling without increasing additional quantization time; and when the reference voltage V ref The value of the pixel voltage V pixel When it is large, it indicates that the light intensity is high at this time. At this time, the signal selection module 320 can be controlled to be turned on through the feedback module 330 to output the first ramp signal for sampling.
[0058] According to the analog-to-digital conversion circuit of the embodiment of the present invention, compared with Figure 1 The conventional analog-to-digital conversion circuit in the embodiment of the present invention is added with a signal selection module 320 and a feedback module 330. When the analog-to-digital conversion circuit is used to perform analog-to-digital conversion on the pixel signal, if the pixel voltage corresponding to the pixel signal is less than the reference voltage, the signal selection module 320 is controlled to be turned on through the feedback module 330 to output the first ramp signal for sampling; if the pixel voltage corresponding to the pixel signal is greater than the reference voltage, the signal selection module 320 is controlled to be turned on through the feedback module 330 to output the maximum value of the first ramp signal and the second ramp signal for sampling. That is, the ramp signal used for sampling can be adaptively adjusted according to the pixel voltage corresponding to the pixel signal, so that different pixel voltages have different related sampling times, thereby saving power consumption and avoiding resource waste.
[0059] At the same time, compared with Figure 1 In the traditional analog-to-digital conversion circuit, the output end of the ramp signal generator 310 outputs the first ramp signal or the second ramp signal, the slope corresponding to the first ramp signal and the slope corresponding to the second ramp signal are opposite to each other, and when the pixel voltage is greater than the reference voltage, the maximum value of the first ramp signal and the second ramp signal is used for sampling, which will not significantly increase the additional quantization time, thereby ensuring the output frame rate of the image, which is beneficial to improving the user experience in preview, recording and other modes.
[0060] In some embodiments, Figure 4As shown, the feedback module 330 includes an AND gate circuit 331 and a trigger 332; the output end of the AND gate circuit 331 is connected to the input end of the trigger 332, and the output end of the trigger 332 is connected to the control end of the signal selection module 320;
[0061] The input end of the AND gate circuit 331 is connected to the first output end of the comparator 340. The AND gate circuit 331 is used to invert the comparison result of the comparator 340 and perform an AND operation with the target flag bit to obtain a switch control signal.
[0062] The trigger 332 is used to transmit the switch control signal to the control terminal of the signal selection module 320 under the triggering of the trigger signal, so as to control the signal selection module 320 to be turned on.
[0063] The trigger 352 may be a D trigger, or a JK trigger, a T trigger, etc. according to actual needs.
[0064] Continuing with the above embodiment, the inputs of the AND gate circuit 331 are respectively the inverted signal of the comparison result Comp_out output by the comparator 340 and the target flag bit ramp_flag corresponding to the comparison stage. ref When , it indicates that the analog-to-digital conversion circuit enters the comparison phase, at which time ramp_flag = 1, and in other phases ramp_flag = 0. The truth table of the entire feedback module 330 is as follows:
[0065] Comp_out Ramp_flag D Flip Flop Lighting conditions Ramp signal 0 0 0 Non-comparative stage Maintain the previous status 0 1 1 Low light environment 2 types of ramp signals 1 0 0 Non-comparative stage Maintain the previous status 1 1 0 Medium and high light environment 1 ramp signal
[0066] The working principle of the feedback module 330 is as follows: When the analog-to-digital conversion circuit enters the comparison phase, ramp_flag = 1. If V pixel >V ref , indicating that the pixel is in a low illumination state at this time, Comp_out = 0, which is 1 after being inverted. Therefore, after passing through the AND gate circuit, the D flip-flop outputs 1, and then obtains the switch control signal, and the value of the D flip-flop remains unchanged before the next clock cycle is triggered (the value of the D flip-flop will only change in the comparison stage, and remain unchanged during the quantization process).
[0067] In some embodiments, Figure 5 As shown, the ramp signal generating module 310 includes a first signal output terminal and a second signal output terminal, and the first signal output terminal is used to output the first ramp signal V ramp1 The second signal output terminal is used to output the second ramp signal V ramp2 ;
[0068] The signal selection module 320 includes a first operational amplifier 321, a first diode 322, a second operational amplifier 323, a second diode 324 and a control switch 325;
[0069] The first signal output terminal is connected to the first terminal of the first operational amplifier 321, and the second terminal of the first operational amplifier 321 is connected to the first input terminal of the comparator 340 and the third terminal of the first operational amplifier 321 through the first diode 322;
[0070] The second signal output terminal is connected to one end of the control switch 325 and the first end of the second operational amplifier 323, the second end of the second operational amplifier 323 is connected to the first input end of the comparator 340 and the third end of the second operational amplifier 324 through the second diode 324; the other end of the control switch 325 is grounded;
[0071] When the feedback module controls the control switch 325 to be closed, the signal selection module 320 outputs a first ramp signal. When the feedback module controls the control switch to be open, the signal selection module outputs a maximum value between the first ramp signal and the second ramp signal.
[0072] In an exemplary embodiment, taking the control switch 325 as switch S as an example, when the switch S is closed, the signal selection module 320 outputs the first ramp signal V ramp1 When the switch S is disconnected, the signal selection module 320 outputs the maximum value V of the first ramp signal and the second ramp signal ramp3 .
[0073] In some embodiments, the comparator 340 is also used to compare the pixel voltage corresponding to the pixel signal with the sampling voltage corresponding to the first ramp signal, or to compare the pixel voltage with the sampling voltage corresponding to the maximum value of the first ramp signal and the second ramp signal, to obtain a first comparison result; the counter 350 is used to output a digital signal corresponding to the pixel signal based on the first comparison result of the comparator 340.
[0074] In some embodiments, before the analog-to-digital conversion circuit performs analog-to-digital conversion on the pixel signal, the ramp signal generating module 310 is further used to output a reset ramp signal;
[0075] The signal selection module 320 is turned on by controlling the feedback module 330 to output a reset ramp signal for sampling; the comparator 330 is used to compare the reset sampling voltage corresponding to the reset ramp signal with the reset voltage corresponding to the pixel signal to obtain a second comparison result; the counter 340 is used to output a reset signal corresponding to the pixel signal based on the second comparison result of the comparator 340.
[0076] Continuing with the above embodiment, before the pixel signal is converted into analog-to-digital through the analog-to-digital conversion circuit, that is, in the reset signal sampling stage, the ramp signal generating module 310 is also used to output the reset ramp signal; the signal selecting module 320 is controlled to be turned on through the feedback module 330 to output the reset ramp signal for sampling; the comparator 330 compares the reset sampling voltage corresponding to the reset ramp signal with the reset voltage corresponding to the pixel signal to obtain a second comparison result; the counter 340 is used to output the reset signal corresponding to the pixel signal based on the second comparison result of the comparator 340.
[0077] In some embodiments, the analog-to-digital conversion circuit further includes a latch; the latch is used to latch a first count value according to a reset signal and latch a second count value according to a digital signal; wherein the first count value and the second count value are used to determine a quantization value corresponding to the pixel signal.
[0078] In an exemplary embodiment, assuming that the correlated multi-sampling technique with M=4 is performed under low illumination and the correlated multi-sampling technique with M=2 is performed under medium and high illumination, the ramp signal generating module 310 can generate two different ramp signals V ramp1 and V ramp2 After completing the reset signal sampling, the feedback circuit selects the appropriate ramp signal according to the size of the Comp_out signal. If Comp_out = 0, the ramp signal V ramp1 and V ramp2 Complete 4 times of correlated multi-sampling together, and select the actual working ramp signal through the signal ramp selection signal r_choose during sampling; if Comp_out = 1, only the ramp signal V ramp1 Perform 2 times correlated multi-sampling.
[0079] Under medium and high illumination, the working timing of the ADC is as follows Figure 6 As shown. Before the comparison stage, the circuit cannot know the size of the corresponding pixel exposure value, that is, it cannot obtain the illumination information. Therefore, in the reset signal sampling stage, the ramp signal V ramp1 The reset level is sampled four times. Since the exposure signal is sampled only twice in the subsequent stage, the reset signal and the exposure signal are sampled at different times. In order to facilitate subsequent calculations, when the reset signal is sampled, the signal value after the second sampling (i.e., the first count value) is latched into the internal register through the latch signal. After the reset signal sampling is completed, the value is released and inverted as the "base" of the quantized exposure signal. The sampling timing under medium and high illumination in the embodiment of the present application is different from Figure 2 The timing shown is relatively close, and the main difference lies in the latch mechanism mentioned above. On this basis, the quantized value S corresponding to the pixel signal out It can be calculated by the following formula:
[0080]
[0081] Among them, S out1 is the latch value of the reset signal after 2 samplings, S out2 is the value of the exposure signal after being sampled twice (ie, the second count value). The division operation in the formula can be implemented by a shift circuit.
[0082] Under low illumination, the working sequence of the analog-to-digital conversion circuit is as follows: Figure 7 As shown. The quantization stage of the reset signal performs 4 correlated multi-sampling. When the exposed pixel value is input to the positive stage of the comparator, the ramp generator generates a V ref The reference signal is input to the negative electrode of the comparator. Since the pixel value is small under low illumination, there is V pixel >V ref (Since both are negative numbers, the absolute value is compared). At this time, the feedback circuit is activated and the r_choose signal takes effect. When the r_choose signal is 1, the analog-to-digital conversion circuit receives the ramp signal V ramp1 ; When the r_choose signal is 0, the analog-to-digital conversion circuit receives the ramp signal V ramp2 The equivalent ramp signal in the final exposure signal quantization stage is V ramp3 On this basis, the ADC circuit samples the exposure signal 4 times in total when quantizing it, and the quantization time is basically the same as the correlated multi-sampling of M=2, without adding any additional time overhead. The quantization value S corresponding to the pixel signal out It can be calculated by the following formula:
[0083]
[0084] Among them, S out1 is the value of the reset signal after 4 samplings (i.e., the first count value), S out2 is the value of the exposure signal after being sampled four times (ie, the second count value). The division operation in the formula can be implemented by a shift circuit.
[0085] See also Figure 8 , Figure 8 800 is a flow chart of an analog-to-digital conversion method, which is applied to the analog-to-digital conversion circuit in the above embodiment. The method 800 includes:
[0086] S801: Outputting a first ramp signal or a second ramp signal through a ramp signal generating module, wherein a slope corresponding to the first ramp signal and a slope corresponding to the second ramp signal are opposite to each other;
[0087] S802: Controlling a signal selection module through a feedback module to output the first ramp signal or a maximum value between the first ramp signal and a second ramp signal;
[0088] S803: acquiring a pixel signal through a comparator, and when performing analog-to-digital conversion on the pixel signal through the analog-to-digital conversion circuit, if a pixel voltage corresponding to the pixel signal is less than a reference voltage, sampling is performed through the first ramp signal; if the pixel voltage corresponding to the pixel signal is greater than the reference voltage, sampling is performed through the maximum value of the first ramp signal and the second ramp signal;
[0089] S804: Output a digital signal corresponding to the pixel signal through a counter.
[0090] In some embodiments, the feedback module includes an AND gate circuit and a trigger; after the ramp signal generating module outputs the first ramp signal or the second ramp signal, it also includes:
[0091] Get the pre-configured target flags;
[0092] The comparison result of the comparator is inverted by the AND gate circuit and then ANDed with the target flag bit to obtain a switch control signal;
[0093] The switch control signal is transmitted to the control end of the signal selection module through the trigger to control the signal selection module to output a corresponding ramp signal.
[0094] In some embodiments, after the ramp signal generating module outputs the first ramp signal or the second ramp signal, the method further includes:
[0095] The feedback module is used to control the on-off of a control switch included in the signal selection module, so as to control the signal selection module to output a corresponding ramp signal.
[0096] In some embodiments, in the above S804, outputting the digital signal corresponding to the pixel signal through a counter includes:
[0097] Comparing, by a comparator, a pixel voltage corresponding to the pixel signal and a sampling voltage corresponding to the first ramp signal, or comparing the pixel voltage and a sampling voltage corresponding to a maximum value between the first ramp signal and the second ramp signal, to obtain a first comparison result;
[0098] The first comparison result is counted by the counter to obtain a digital signal corresponding to the pixel signal.
[0099] In some embodiments, in the above S803, before performing analog-to-digital conversion on the pixel signal by the analog-to-digital conversion circuit, the process further includes:
[0100] Outputting a reset ramp signal through a ramp signal generating module;
[0101] Controlling the signal selection module to output the reset ramp signal through the feedback module;
[0102] Comparing the reset sampling voltage corresponding to the reset ramp signal with the reset voltage corresponding to the pixel signal by a comparator to obtain a second comparison result;
[0103] The second comparison result is counted by the counter to obtain a reset signal corresponding to the pixel signal.
[0104] In some embodiments, in the above S804, after the counter outputs the digital signal corresponding to the pixel signal, the method further includes:
[0105] A first count value is latched according to the reset signal, and a second count value is latched according to the digital signal; wherein the first count value and the second count value are used to determine a quantization value corresponding to the pixel signal.
[0106] An embodiment of the present application provides an analog-to-digital conversion method, which is applied to the analog-to-digital conversion circuit in the above embodiment, outputting a first ramp signal or a second ramp signal through a ramp signal generating module, wherein the slope corresponding to the first ramp signal and the slope corresponding to the second ramp signal are opposite to each other; controlling a signal selection module through a feedback module to output the first ramp signal, or the maximum value of the first ramp signal and the second ramp signal; acquiring a pixel signal through a comparator, and when performing analog-to-digital conversion on the pixel signal through the analog-to-digital conversion circuit, if the pixel voltage corresponding to the pixel signal is less than a reference voltage, sampling is performed through the first ramp signal; if the pixel voltage corresponding to the pixel signal is greater than the reference voltage, sampling is performed through the maximum value of the first ramp signal and the second ramp signal; and outputting a digital signal corresponding to the pixel signal through a counter.
[0107] In this way, the ramp signal used for sampling can be adaptively adjusted according to the size of the pixel voltage, so that different pixel voltages have different related sampling times, thereby avoiding resource waste and saving power consumption. In addition, the slope corresponding to the first ramp signal and the slope corresponding to the second ramp signal are opposite to each other. When the pixel voltage is greater than the reference voltage, the maximum value of the first ramp signal and the second ramp signal is used for sampling, and the related sampling times are increased without significantly increasing the additional quantization time, so that the image quality can be improved without reducing the output frame rate of the image, which is conducive to improving the user experience in preview, recording and other modes.
[0108] An embodiment of the present application also provides an image sensor, comprising a pixel array, the above-mentioned analog-to-digital conversion circuit and an image signal processor; the pixel array comprises a plurality of target pixels, and the output ends of the target pixels in the same column are electrically connected to the analog-to-digital conversion circuit; the image signal processor is used to process the exposure digital signals of the target pixels to obtain a processed image.
[0109] In the specific implementation, Fig. 9 As shown, the pixel array includes m rows and n columns of pixels, where m and n are positive integers, and each column of pixels shares one of the above-mentioned analog-to-digital conversion circuits (ADC), and exposure and signal reading are performed row by row. That is to say, when a row is exposed, the output voltage of each pixel in the row is amplified by the amplifier and then enters the ADC. The ADC is used to convert the analog pixel voltage into an exposure digital signal, which is then transmitted based on the standardized serial interface protocol (Mobile Industry Processor Interface, MIPI) of mobile devices and mobile computing platforms to form an exposure digital signal matrix (i.e., a RAW image), and then the exposure digital signal matrix is processed by an image signal processor (Image Signal Processor, ISP) to obtain a processed image. Exemplarily, the circuit structure of each pixel in the pixel array can be as follows Fig.10 As shown in , the light signal in the scene is captured by the sensor and converted into a pixel signal.
[0110] The embodiment of the present application also provides a camera module, including the above-mentioned image sensor. The camera module also includes a lens, an infrared cutoff filter and a voice coil motor; the lens is used to focus light onto the image sensor; the infrared cutoff filter is used to filter out infrared light from entering the image sensor; the image sensor is used to adaptively adjust the ramp signal according to the pixel voltage of the target pixel, so that the target pixel in different scenes has different related sampling times; the voice coil motor is used to achieve focus adjustment by controlling the movement of the lens.
[0111] The embodiment of the present application also provides an electronic device, including the above-mentioned camera module. The electronic device can be a terminal or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc. It can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.
[0112] The analog-to-digital conversion method provided in the embodiment of the present application can be executed by an analog-to-digital conversion device. In the embodiment of the present application, an analog-to-digital conversion device executing the analog-to-digital conversion method is taken as an example to illustrate the device of the analog-to-digital conversion method provided in the embodiment of the present application.
[0113] Fig.11 1 is a schematic diagram of the structure of an analog-to-digital conversion device. As shown in the figure, the analog-to-digital conversion device 1100 includes:
[0114] A signal generating module 1110, configured to output a first ramp signal or a second ramp signal, wherein a slope corresponding to the first ramp signal and a slope corresponding to the second ramp signal are opposite to each other;
[0115] The control module 1120 is used to control the selection module 1130 to output the first ramp signal or the maximum value of the first ramp signal and the second ramp signal;
[0116] a comparison module 1140, configured to obtain a pixel signal, and when performing analog-to-digital conversion on the pixel signal through the analog-to-digital conversion circuit, if a pixel voltage corresponding to the pixel signal is less than a reference voltage, sampling is performed through the first ramp signal; if a pixel voltage corresponding to the pixel signal is greater than the reference voltage, sampling is performed through a maximum value of the first ramp signal and the second ramp signal;
[0117] The counting module 1150 is used to output a digital signal corresponding to the pixel signal.
[0118] In some embodiments, the control module 1120 includes:
[0119] An AND operation unit, used for obtaining a pre-configured target flag bit; inverting the comparison result of the comparison module 1140 and performing an AND operation with the target flag bit to obtain a switch control signal;
[0120] The trigger unit is used to transmit the switch control signal to the control end of the selection module 1130 to control the selection module 1130 to output a corresponding ramp signal.
[0121] In some embodiments, the control module 1120 is further configured to:
[0122] The on-off of the control switch included in the selection module 1130 is controlled to control the selection module 1130 to output a corresponding ramp signal.
[0123] In some embodiments, the comparison module 1140 is further configured to:
[0124] Comparing a pixel voltage corresponding to the pixel signal with a sampling voltage corresponding to the first ramp signal, or comparing the pixel voltage with a sampling voltage corresponding to a maximum value of the first ramp signal and the second ramp signal, to obtain a first comparison result;
[0125] The counting module 1150 is further used for:
[0126] The first comparison results are counted to obtain a digital signal corresponding to the pixel signal.
[0127] In some embodiments, before the analog-to-digital conversion circuit performs analog-to-digital conversion on the pixel signal, the signal generating module 1110 is used to output a reset ramp signal;
[0128] The control module 1120 is used to control the selection module 1130 to output the reset ramp signal;
[0129] The comparison module 1140 is used to compare the reset sampling voltage corresponding to the reset ramp signal with the reset voltage corresponding to the pixel signal to obtain a second comparison result;
[0130] The counting module 1150 counts the second comparison result to obtain a reset signal corresponding to the pixel signal.
[0131] In some embodiments, the analog-to-digital conversion device 1100 further includes:
[0132] A latch module is used to latch a first count value according to the reset signal and latch a second count value according to the digital signal; wherein the first count value and the second count value are used to determine a quantization value corresponding to the pixel signal.
[0133] An embodiment of the present application provides an analog-to-digital conversion device, including a signal generating module, a control module, a selection module, a comparison module and a counting module; the signal generating module outputs a first ramp signal or a second ramp signal, and the slope corresponding to the first ramp signal and the slope corresponding to the second ramp signal are opposite to each other; the control module controls the selection module to output the first ramp signal, or the maximum value of the first ramp signal and the second ramp signal; the comparison module acquires a pixel signal, and when the analog-to-digital conversion circuit performs analog-to-digital conversion on the pixel signal, if the pixel voltage corresponding to the pixel signal is less than a reference voltage, sampling is performed through the first ramp signal; if the pixel voltage corresponding to the pixel signal is greater than the reference voltage, sampling is performed through the maximum value of the first ramp signal and the second ramp signal; the counting module outputs a digital signal corresponding to the pixel signal.
[0134] In this way, the ramp signal used for sampling can be adaptively adjusted according to the size of the pixel voltage, so that different pixel voltages have different related sampling times, thereby avoiding resource waste and saving power consumption. In addition, the slope corresponding to the first ramp signal and the slope corresponding to the second ramp signal are opposite to each other. When the pixel voltage is greater than the reference voltage, the maximum value of the first ramp signal and the second ramp signal is used for sampling, and the related sampling times are increased without significantly increasing the additional quantization time, so that the image quality can be improved without reducing the output frame rate of the image, which is conducive to improving the user experience in preview, recording and other modes.
[0135] Alternatively, if Fig.12 As shown, an embodiment of the present application also provides an electronic device 1200, including a processor 1201 and a memory 1202, wherein the memory 1202 stores programs or instructions that can be executed on the processor 1201, and when the program or instructions are executed by the processor 1201, the various steps of the above-mentioned analog-to-digital conversion method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not repeated here.
[0136] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.
[0137] Fig.13 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.
[0138] The electronic device 1300 includes but is not limited to: a radio frequency unit 1301, a network module 1302, an audio output unit 1303, an input unit 1304, a sensor 1305, a display unit 1306, a user input unit 1307, an interface unit 1308, a memory 1309, and a processor 1310 and other components.
[0139] Those skilled in the art will appreciate that the electronic device 1300 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1310 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.13 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.
[0140] In the embodiment of the present application, the electronic device 1300 includes the analog-to-digital conversion circuit in the above embodiment, which will not be described in detail here.
[0141] The processor 1310 is used to control the ramp signal generating module to output a first ramp signal or a second ramp signal, wherein the slope corresponding to the first ramp signal and the slope corresponding to the second ramp signal are opposite to each other;
[0142] Controlling the signal selection module to output the first ramp signal or the maximum value of the first ramp signal and the second ramp signal through the feedback module;
[0143] Controlling the comparator to obtain a pixel signal, and when performing analog-to-digital conversion on the pixel signal through the analog-to-digital conversion circuit, if a pixel voltage corresponding to the pixel signal is less than a reference voltage, sampling is performed through the first ramp signal; if the pixel voltage corresponding to the pixel signal is greater than the reference voltage, sampling is performed through the maximum value of the first ramp signal and the second ramp signal;
[0144] The counter is controlled to output a digital signal corresponding to the pixel signal.
[0145] In this way, the ramp signal used for sampling can be adaptively adjusted according to the size of the pixel voltage, so that different pixel voltages have different related sampling times, thereby avoiding resource waste and saving power consumption. In addition, the slope corresponding to the first ramp signal and the slope corresponding to the second ramp signal are opposite to each other. When the pixel voltage is greater than the reference voltage, the maximum value of the first ramp signal and the second ramp signal is used for sampling, and the related sampling times are increased without significantly increasing the additional quantization time, so that the image quality can be improved without reducing the output frame rate of the image, which is conducive to improving the user experience in preview, recording and other modes.
[0146] In some embodiments, the feedback module includes an AND gate circuit and a trigger; the processor 1310, after being used to control the ramp signal generating module to output the first ramp signal or the second ramp signal, is further used to:
[0147] Get the pre-configured target flags;
[0148] Control the AND gate circuit to invert the comparison result of the comparator and perform an AND operation with the target flag bit to obtain a switch control signal;
[0149] The trigger is controlled to transmit the switch control signal to the control end of the signal selection module, so as to control the signal selection module to output a corresponding ramp signal.
[0150] In some embodiments, the processor 1310, after being used to control the ramp signal generating module to output the first ramp signal or the second ramp signal, is further used to:
[0151] The feedback module is used to control the on-off of a control switch included in the signal selection module, so as to control the signal selection module to output a corresponding ramp signal.
[0152] In some embodiments, the processor 1310 is specifically configured to:
[0153] Controlling the comparator to compare the pixel voltage corresponding to the pixel signal with the sampling voltage corresponding to the first ramp signal, or to compare the pixel voltage with the sampling voltage corresponding to the maximum value of the first ramp signal and the second ramp signal, to obtain a first comparison result;
[0154] The counter is controlled to count the first comparison result to obtain a digital signal corresponding to the pixel signal.
[0155] In some embodiments, the processor 1310, before being used to control the analog-to-digital conversion circuit to perform analog-to-digital conversion on the pixel signal, is further used to:
[0156] Control the ramp signal generating module to output a reset ramp signal;
[0157] Controlling the signal selection module to output the reset ramp signal through the feedback module;
[0158] Controlling the comparator to compare the reset sampling voltage corresponding to the reset ramp signal with the reset voltage corresponding to the pixel signal to obtain a second comparison result;
[0159] The counter is controlled to count the second comparison result to obtain a reset signal corresponding to the pixel signal.
[0160] In some embodiments, the processor 1310, after being used to control the counter to output the digital signal corresponding to the pixel signal, is further used to:
[0161] A first count value is latched according to the reset signal, and a second count value is latched according to the digital signal; wherein the first count value and the second count value are used to determine a quantization value corresponding to the pixel signal.
[0162] It should be understood that in the embodiment of the present application, the input unit 1304 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 13042, and the graphics processor 13041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1306 may include a display panel 13061, and the display panel 13061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1307 includes a touch panel 13071 and at least one of other input devices 13072. The touch panel 13071 is also called a touch screen. The touch panel 13071 may include two parts: a touch detection device and a touch controller. Other input devices 13072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.
[0163] The memory 1309 can be used to store software programs and various data. The memory 1309 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 1309 may include a volatile memory or a non-volatile memory, or the memory 1309 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 1309 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.
[0164] The processor 1310 may include one or more processing units; optionally, the processor 1310 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1310.
[0165] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned analog-to-digital conversion method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0166] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.
[0167] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned analog-to-digital conversion method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0168] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
[0169] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned analog-to-digital conversion method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0170] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.
[0171] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.
[0172] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.
Claims
1. An analog-to-digital conversion circuit, characterized in that: It includes a ramp signal generating module (310), a signal selecting module (320), a feedback module (330), a comparator (340) and a counter (350); The first end of the signal selection module (320) is connected to the ramp signal generation module (310), and the ramp signal generation module (310) is used to output a first ramp signal or a second ramp signal, and the slope corresponding to the first ramp signal and the slope corresponding to the second ramp signal are opposite numbers to each other; A first end of the feedback module (330) is connected to a control end of the signal selection module (320), the feedback module (330) is used to control the on and off of the signal selection module (320), and a second end of the feedback module (330) is connected to a first output end of the comparator (340); The first input end of the comparator (340) is connected to the second end of the signal selection module (320), the second input end of the comparator (340) is used to receive a pixel signal, and the comparator (340) is used to compare the pixel voltage corresponding to the pixel signal with the reference voltage; The counter (350) is connected to the second output terminal of the comparator (340), and the counter (350) is used to output a digital signal corresponding to the pixel signal; When the pixel signal is subjected to analog-to-digital conversion by the analog-to-digital conversion circuit, if the pixel voltage corresponding to the pixel signal is less than the reference voltage, the signal selection module (320) is controlled to be turned on by the feedback module (330) to output the first ramp signal for sampling; If the pixel voltage corresponding to the pixel signal is greater than the reference voltage, the signal selection module (320) is controlled to be turned on through the feedback module (330) to output the maximum value of the first ramp signal and the second ramp signal for sampling.
2. The analog-to-digital conversion circuit according to claim 1, characterized in that: The feedback module (330) comprises an AND gate circuit (331) and a trigger (332); the output end of the AND gate circuit (331) is connected to the input end of the trigger (332), and the output end of the trigger (332) is connected to the control end of the signal selection module (320); The input end of the AND gate circuit (331) is connected to the first output end of the comparator (340), and the AND gate circuit (331) is used to invert the comparison result of the comparator (340) and perform an AND operation with the target flag bit to obtain a switch control signal; The trigger (332) is used to transmit the switch control signal to the control end of the signal selection module (320) under the triggering of the trigger signal, so as to control the signal selection module (320) to be turned on.
3. The analog-to-digital conversion circuit according to claim 1, characterized in that: The ramp signal generating module (310) comprises a first signal output terminal and a second signal output terminal, the first signal output terminal is used to output the first ramp signal, and the second signal output terminal is used to output the second ramp signal; The signal selection module (320) comprises a first operational amplifier (321), a first diode (322), a second operational amplifier (323), a second diode (324) and a control switch (325); The first signal output terminal is connected to a first terminal of the first operational amplifier (321), and a second terminal of the first operational amplifier (321) is connected to a first input terminal of the comparator (340) and a third terminal of the first operational amplifier (321) via the first diode (322); The second signal output terminal is connected to one end of the control switch (325) and the first end of the second operational amplifier (323); the second end of the second operational amplifier (323) is connected to the first input end of the comparator (340) and the third end of the second operational amplifier (324) through the second diode (324); the other end of the control switch (325) is grounded; When the feedback module controls the control switch (325) to be closed, the signal selection module (320) outputs the first ramp signal; when the feedback module controls the control switch to be open, the signal selection module outputs the maximum value of the first ramp signal and the second ramp signal.
4. The analog-to-digital conversion circuit according to claim 1, characterized in that: The comparator (340) is further used to compare the pixel voltage corresponding to the pixel signal with the sampling voltage corresponding to the first ramp signal, or to compare the pixel voltage with the sampling voltage corresponding to the maximum value of the first ramp signal and the second ramp signal, to obtain a first comparison result; The counter (350) is used to output a digital signal corresponding to the pixel signal based on the first comparison result of the comparator (340).
5. The analog-to-digital conversion circuit according to claim 1, characterized in that: Before the analog-to-digital conversion circuit performs analog-to-digital conversion on the pixel signal, the ramp signal generating module (310) is further used to output a reset ramp signal; The signal selection module (320) is controlled to be turned on through the feedback module (330) to output the reset ramp signal for sampling; the comparator (330) is used to compare the reset sampling voltage corresponding to the reset ramp signal with the reset voltage corresponding to the pixel signal to obtain a second comparison result; and the counter (340) is used to output the reset signal corresponding to the pixel signal based on the second comparison result of the comparator (340).
6. The analog-to-digital conversion circuit according to claim 5, characterized in that: The analog-to-digital conversion circuit also includes a latch; the latch is used to latch a first count value according to the reset signal and latch a second count value according to the digital signal; wherein the first count value and the second count value are used to determine a quantization value corresponding to the pixel signal.
7. An analog-to-digital conversion method, characterized in that: Applied to the analog-to-digital conversion circuit according to any one of claims 1 to 6, the method comprising: Outputting a first ramp signal or a second ramp signal through a ramp signal generating module, wherein the slope corresponding to the first ramp signal and the slope corresponding to the second ramp signal are opposite to each other; Controlling the signal selection module to output the first ramp signal or the maximum value of the first ramp signal and the second ramp signal through the feedback module; A pixel signal is acquired through a comparator, and when the analog-to-digital conversion circuit performs analog-to-digital conversion on the pixel signal, if a pixel voltage corresponding to the pixel signal is less than a reference voltage, sampling is performed through the first ramp signal; if the pixel voltage corresponding to the pixel signal is greater than the reference voltage, sampling is performed through a maximum value of the first ramp signal and the second ramp signal; A digital signal corresponding to the pixel signal is outputted through a counter.
8. The method according to claim 7, characterized in that The feedback module includes an AND gate circuit and a trigger; after the ramp signal generating module outputs the first ramp signal or the second ramp signal, it also includes: Get the pre-configured target flags; The comparison result of the comparator is inverted by the AND gate circuit, and then ANDed with the target flag bit to obtain a switch control signal; The switch control signal is transmitted to the control end of the signal selection module through the trigger to control the signal selection module to output a corresponding ramp signal.
9. The method according to claim 7, characterized in that: After the ramp signal generating module outputs the first ramp signal or the second ramp signal, the method further includes: The feedback module is used to control the on-off of a control switch included in the signal selection module, so as to control the signal selection module to output a corresponding ramp signal.
10. The method according to claim 7, characterized in that The step of outputting a digital signal corresponding to the pixel signal through a counter comprises: Comparing, by a comparator, a pixel voltage corresponding to the pixel signal and a sampling voltage corresponding to the first ramp signal, or comparing the pixel voltage and a sampling voltage corresponding to a maximum value between the first ramp signal and the second ramp signal, to obtain a first comparison result; The first comparison result is counted by the counter to obtain a digital signal corresponding to the pixel signal.
11. The method according to claim 7, characterized in that Before the analog-to-digital conversion of the pixel signal is performed by the analog-to-digital conversion circuit, the method further includes: Outputting a reset ramp signal through a ramp signal generating module; Controlling the signal selection module to output the reset ramp signal through the feedback module; Comparing the reset sampling voltage corresponding to the reset ramp signal with the reset voltage corresponding to the pixel signal by a comparator to obtain a second comparison result; The second comparison result is counted by the counter to obtain a reset signal corresponding to the pixel signal.
12. The method according to claim 11, characterized in that After the counter outputs the digital signal corresponding to the pixel signal, the method further includes: A first count value is latched according to the reset signal, and a second count value is latched according to the digital signal; wherein the first count value and the second count value are used to determine a quantization value corresponding to the pixel signal.
13. An image sensor, characterized in that: comprising a pixel array, an analog-to-digital conversion circuit as claimed in any one of claims 1 to 6, and an image signal processor; The pixel array includes a plurality of target pixels, and output ends of the target pixels in the same column are electrically connected to the analog-to-digital conversion circuit; The analog-to-digital conversion circuit is used to perform analog-to-digital conversion on the pixel signal of the target pixel to obtain a digital signal corresponding to the pixel signal; The image signal processor is used to process the digital signal to obtain a processed image.
14. A camera module, characterized in that: The image sensor comprises an image sensor, wherein the image sensor adopts the analog-to-digital conversion circuit according to any one of claims 1 to 6 to perform analog-to-digital conversion, or adopts the analog-to-digital conversion method according to any one of claims 7 to 12 to perform analog-to-digital conversion.
15. An electronic device, characterized in that: Comprising the camera module as described in claim 14.
Citation Information
Patent Citations
Double-slope double-edge downward counting analog-to-digital conversion device and conversion method thereof
CN114157301A
Analog-to-digital converter of low-noise column parallel monoclinic low-light level image sensor
CN115052118A
Analog-to-digital conversion circuit
CN117200789A
Pipeline resonant and non-resonant switched capacitor converter circuit
US20210367511A1
