Column-shared ADCs for image sensors and method of operation

The proposed ADC architecture for endoscopic sensors optimizes size, power, and speed by sharing columns with a single operational amplifier for parallel reset sampling and sequential signal conversion, addressing the limitations of existing technologies in endoscopic image sensors.

JP7592059B2Active Publication Date: 2024-11-29TELEDYNE INNOVACIONES MICROELECTRONICSAS SLU
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2022177456
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2021-11-05
Filing Date
2022-11-04
Publication Date
2024-11-29
Estimated Expiration
2042-11-04

AI Technical Summary

Technical Problem

Existing image sensors for endoscopic applications face challenges in minimizing size, pixel resolution, peripheral circuit area, power consumption, and frame rate while transitioning to digital output, with current ADC architectures occupying significant space and requiring complex column decoders.

Method used

An analog-to-digital converter architecture that shares N columns, utilizing a single operational amplifier and readout capacitors for parallel reset value sampling and sequential signal conversion, enabling correlated double sampling in the analog domain to reduce the number of conversions and optimize space and power consumption.

Benefits of technology

This architecture achieves compact size, low power consumption, and high frame rates by parallel sampling of reset values and sequential signal conversion, ensuring efficient image quality with reduced noise and minimal space requirements.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007592059000002
    Figure 0007592059000002
  • Figure 0007592059000003
    Figure 0007592059000003
  • Figure 0007592059000004
    Figure 0007592059000004
Patent Text Reader

Abstract

To obtain convenience balance between an operation speed in an imaging device and consideration matters on a space and a power consumption.SOLUTION: In an analog to digital converter 100, pixel column outputs 151 and 152 are sampled by capacitors 111 and 112, respectively. In a reset phase of operation, each pixel in rows a, b under consideration is reset, and an operational amplifier 123 operating in a voltage follower mode is coupled to all sampling capacitors in parallel to obtain common reset value of the pixel sensors 151a, 152a of that row. in an imaging phase of operation. an inverting input 122 of the operational amplifier operating in a comparator mode is coupled to each capacitor in turn after activating the respective pixel sensors, while exposing the non-inverting signal 121 by a ramp signal source 127 to an analog ramp reference voltage. Thereby, timing of toggling of the operational amplifier reflects the value of the pixel under consideration, corrected for the reset value.SELECTED DRAWING: Figure 1a
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to image sensor circuits, and in particular to the analog-to-digital conversion components of such circuits. [Background technology]

[0002] There are many applications where it is desirable to minimize the size of the sensor. Examples include endoscopy, medical sensing, machine inspection, surveillance, Internet of Things, etc. Image sensors for endoscopy systems and similar situations require several specific features that are not met by prior art off-the-shelf image sensors available in the market. These include: 1. The size of the image sensor is extremely small. Depending on the pixel array resolution of the endoscopy, the size of the sensor can be as small as 3 x 3 mm, depending on the final function of the endoscope (i.e. bronchoscopy, colonoscopy, laparoscopy, laryngoscopy). 2 From 1×1mm 2 This can sometimes happen. 2. To maximize the resolution of the pixel array, the pixel size is also extremely small. The pixel size is typically 1 x 1 μm. 2 From 3×3 μm 2 That is until now. 3. To maximize pixel array resolution in the same area, the peripheral circuit area must be made extremely small. 4. Because the sensor will be inside the human body cavity and will share space with other systems such as lighting and other medical tools, power consumption needs to be extremely low. 5. The required frame rate is typically between 60fps and 120fps. There is a need to transmit the digital images over a serial link, which reduces the number of ports and therefore the number of cables.

[0003] For endoscopic sensors, there are still many image sensors with analog output since it is much easier to reduce the peripheral area requiring fewer internal elements.

[0004] However, there are important advantages to using an endoscopic image sensor with a digital output. 1. It eliminates the need for an auxiliary device to convert the output into digital code, reducing the final cost of the system. 2. Digital outputs are much more reliable against interference because the receiver only has to decide between two logic levels. And if a device such as a scalpel is generating electrical noise, the digital output can tolerate a higher level of interference if the output is transmitted in a differential digital manner. 3. Digital output enables high-speed data transfer of up to 3Gbps. 4. Data digitization is done on-chip, and image quality is not dependent on external factors.

[0005] A CMOS image sensor (CIS) basically consists of two main blocks: the pixel matrix and the readout circuitry. The pixel array consists of multiple pixel elements arranged in rows and columns.

[0006] The readout channel digitizes the information in the pixel array to generate a digital image containing the scene information. Most image sensors today have a digital output, which means that the device includes an analog-to-digital converter that optimizes the number of elements from the sensor.

[0007] The readout circuit scans the pixel matrix and outputs the contents of the scene information. The pixel output consists of two components: a reset level, which is the level without charge, and a signal level resulting from the integration of the charge with respect to the reset level. Traditionally, the readout circuit consists of a Correlated Double Sampling (CDS) amplifier that calculates and amplifies the pixel signal to the required level, and an output buffer that takes the analog signal from the sensor, where it is conditioned and digitized. Many modern implementations include an analog-to-digital converter (ADC) on the chip, often followed by an ADC block after the CDS amplifier.

[0008] In many applications, as speed requirements increase, the number of readout channels (conceptually each consisting of a CDS amplifier and an ADC) must also increase. In theory, the achievable CIS frame rate increases linearly with the number of readout elements operating in parallel. In fact, they can be considered as a single readout channel with the effective speed multiplied by the number of replicas.

[0009] In fact, this parallelism can be increased as much as needed, but there are practical limitations such as routing congestion or device placement congestion. Today, many CIS employ a readout element per pixel column, which is responsible for processing the signals coming from the pixels in a single column. It can be expanded to N readout elements per column, increasing the CIS speed by a factor of N per row. The time that one row data is inverted at the output is used to convert the data in the ADC. This time is known as the row time. One of the limitations on the row time is the ADC precision. The higher the precision, the longer the time required to convert the signal.

[0010] There are typically two approaches to AD conversion in endoscopy. 1. Architecture based on one high-speed ADC, the converter is common to all columns of the pixel matrix and is sampled and held per column. 2. An architecture based on multiple converters, one per row. This architecture can reach higher speeds at the expense of more area.

[0011] Typical methods known in the state of the art are described in U.S. Patent Application Publication No. 20070002134A1 ("SIGNAL PROCESSSING DEVICE FOR ENDOSCOPE", Olympus corp.), the paper (M. Vatteroni, et al., "Smart optical CMOS sensor for endoluminal applications", Eurosensors XXIII, 2009), the paper (M. Wany, et al., "Ultrasmall digital image sensor for endoscopic applications", in Proc. Int. Image Sensor Workshop, Jun. 2009, pp. 1-4), the paper (S. Itoh, S. Kawahito, S. Terakawa, "A 2.6mW 2fps QVGA CMOS one-chip wireless camera with digital image transmission function for capsule endoscopes"), the paper (M. Wany, et al., "NanEye-An Endoscopy Sensor With 3-D Image Synchronization", IEEE sensors journal, 2017.)

[0012] For example, the implementation proposed in the paper (M. Vatteroni, et al., "Smart optical CMOS sensor for endoluminal applications", Eurosensors XXIII, 2009) has one AD on the right side of the array. In fact, using one proprietary ADC converter would make the implementation more complex and less optimized. The reason is that it would increase the need to use a column decoder to select the column to be converted. If we were to do a true CDS, we would need a sample-and-hold per column, which would consume extra area and would be difficult to achieve the strong requirements in endoscopy, which require the pixel array to be centrally located. This requirement would be very complex if one ADC was used. The reason is that the ADC would occupy one significant part of the peripheral area.

[0013] As soon as the number of replicas N increases, the footprint increases at least approximately linearly.

[0014] The area increases suggested by the prior art approaches above do not lend themselves well to these situations, and it would be desirable to provide an architecture that overcomes these limitations. Summary of the Invention [Means for solving the problem]

[0015] Summary of the Invention According to a first aspect of the present disclosure, there is provided an analog-to-digital converter for use in a digital imaging device having a plurality of pixel sensors arranged in a two-dimensional matrix including a plurality of columns of pixel sensors, the analog-to-digital converter comprising: a plurality of readout capacitors, each readout capacitor being associated with a respective column of pixel sensors; a first plurality of addressable output switches, each of the first plurality of addressable output switches configured to switchably connect an output of a pixel sensor in a column of the pixel sensor matrix to a first terminal of a readout capacitor associated with that column; an operational amplifier having an inverting input connected to the second terminals of the plurality of readout capacitors and a non-inverting input; a ramp signal source switchably connected to a non-inverting input of the operational amplifier, the ramp signal source configured to output a ramp reference voltage; a mode selection switch configured to switchably connect and disconnect the inverting input of the operational amplifier to either a common reference voltage or the output of the operational amplifier; a controller configured to control the addressable switches such that the analog-to-digital converter operates sequentially in a first mode of operation in which pixel sensors in selected rows of the pixel sensor matrix output reset values, and in a second mode of operation in which pixel sensors in selected rows of the pixel sensor matrix output signal values; a. in a first mode of operation, a first plurality of addressable output switches are closed, such that the pixel sensor outputs of a selected row and each column are simultaneously connected to a first terminal of a readout capacitor, and a mode selection switch is closed and an inverting input of the operational amplifier is connected to a common reference voltage or to an output of the operational amplifier, such that the outputs of the pixel sensors in the row are read out in parallel and the reset values ​​of the pixel sensors in the row are stored on individual readout capacitors; b. in a second mode of operation, the mode selection switch is open to disconnect the inverting input from the output of the operational amplifier or a reference voltage, such that the operational amplifier operates in a comparator mode, and the first plurality of addressable output switches are sequentially closed to sequentially connect the output of the pixel sensor in each column and selected row to the first terminal of a respective readout capacitor, while the second terminal of the readout capacitor is connected to the inverting input of the operational amplifier and the non-inverting input of the operational amplifier is connected to a ramp signal source, and the output of each pixel sensor is sequentially connected to the first terminal of its associated readout capacitor, wherein the value at the inverting input of the operational amplifier corresponds to a reset value stored on the respective readout capacitor minus the output signal of the pixel sensor in the respective column, and said value at the inverting input of the operational amplifier is provided as a digital output value encoded by the timing at which the output of the operational amplifier switches from one output extreme to the other output extreme.

[0016] As mentioned above, the analog-to-digital converter is configured to read out the reset values ​​of each of the pixel sensors in a selected row in parallel with each other. This is made possible by providing a readout capacitor for each column, such that the reset values ​​of each of the columns can be read out and stored in parallel on individual readout capacitors. It will be appreciated that this parallel readout of the reset values ​​of the various columns provides significant time savings when compared to alternative approaches in which the reset values ​​of the various columns are read out sequentially.

[0017] The analog-to-digital converter is further configured to perform correlated double sampling in the analog domain. That is, for each pixel sensor, the analog-to-digital converter is configured to generate an analog signal representing the difference between a reset value and a signal value output from the pixel sensor. Correlated double sampling in the analog domain is enabled by storing the reset value in a readout capacitor during a first mode of operation, and sequentially connecting the outputs of the pixel sensors in each column and selected row to first terminals of respective readout capacitors during a second mode of operation, while the second terminals of the readout capacitors are connected to the inverting inputs of an operational amplifier. As a result, an analog signal representing the difference between the reset value of a given pixel stored in the readout capacitor and the pixel output during the second mode of operation is provided to the inverting input of the operational amplifier. The analog signal representing the difference between the reset value and the signal value output from the pixel sensor (supplied to the inverting input of the operational amplifier during the second mode of operation) is converted to a digital output.

[0018] By performing correlated double sampling in the analog domain, a conversion from analog signal to digital output needs to be performed only once per pixel sensor (and per exposure). This significantly reduces the number of analog-to-digital conversions that need to be performed, for example, when compared to alternative approaches in which correlated double sampling is performed in the digital domain. For example, in some alternative approaches, the reset value and signal value for each pixel can be converted separately to a digital output for each pixel, and the digital outputs can be subtracted from each other to perform correlated double sampling in the digital domain. According to such approaches, at least two conversions from analog signal to digital output need to be performed per pixel sensor (and per exposure). Thus, it will be appreciated that performing correlated double sampling in the analog domain as disclosed herein can provide significant time savings when compared to alternative approaches in which correlated sampling is performed in the digital domain.

[0019] The analog-to-digital converter includes a single operational amplifier for converting the outputs from multiple columns. Such a configuration can enable significant power and / or space savings in an image sensor. Using a single analog-to-digital converter to convert the outputs from multiple columns means that the outputs from the various columns are converted sequentially. However, the additional time cost due to the sequential conversion of the various columns is offset by the parallel readout of the reset values ​​and the implementation of correlated double sampling in the analog domain as described above. Thus, the apparatus and methods provided herein provide a favorable balance between the speed of operation in an imaging device and space and power consumption considerations.

[0020] In a first mode of operation in which the mode selection switch is closed and the inverting input of the operational amplifier is connected to a common reference voltage or to the output of the operational amplifier, the operational amplifier can operate in a voltage follower mode.

[0021] As described above, in the second mode of operation, the operational amplifier operates in a comparator mode. An analog signal (representing the difference between a reset value and the signal value output from the pixel sensor) is provided to the inverting input of the operational amplifier. At the same time, a ramp signal source is connected to the non-inverting input of the operational amplifier. The ramp signal source outputs a ramp reference voltage. That is, the ramp signal source outputs a reference voltage that increases or decreases as a function of time (thus "ramping" over time). When operating in comparator mode, the output of the operational amplifier is at a first output extreme (e.g., negative saturation or positive saturation) when the signal provided to the inverting input is greater than the signal provided to the non-inverting input, and is at a second output extreme (e.g., the other of negative saturation or positive saturation). Thus, the output of the operational amplifier switches from one output extreme to the other output extreme (e.g., from negative saturation or positive saturation) when the ramp reference voltage crosses the analog signal provided to the inverting input of the operational amplifier. Thus, the time at which the output of the operational amplifier switches from one output extreme to the other output extreme represents the analog signal provided to the inverting input of the operational amplifier. The timing at which the output of the operational amplifier switches from one output extreme to the other output extreme can be encoded into a digital signal, for example, by transferring the value of a digital counter to a digital register when the output of the operational amplifier switches from one output extreme to the other output extreme.

[0022] The analog-to-digital converter may further comprise a second plurality of addressable output switches. Each of the second plurality of output switches may be arranged to switchably connect a second terminal of a readout capacitor of the plurality of readout capacitors to an inverting input of the operational amplifier. In a first mode of operation, the second plurality of output switches may be closed in parallel with each other, such that each of the second terminals of the readout capacitors is connected to the inverting input of the operational amplifier simultaneously and during parallel readout from the reset value of the pixel sensors. In a second mode of operation, the second plurality of output switches may be closed sequentially to sequentially connect each of the second terminals of the readout capacitors to the inverting input of the operational amplifier. For example, the second plurality of output switches may be closed sequentially substantially in agreement with each of the first plurality of output switches. For example, an output switch of the first plurality of output switches and an output switch of the second plurality of output switches associated with the same readout capacitor may be closed substantially simultaneously during the second mode of operation.

[0023] The output of the operational amplifier can be fed to an output register synchronized with sequentially connecting the outputs of the pixel sensors in each column and selected row to the first terminals of respective readout capacitors.

[0024] The analog-to-digital converter disclosed herein allows for a single digital output register per analog-to-digital converter. As described above, in the second mode of operation, the outputs of the pixel sensors in each column and selected row are sequentially connected to the first terminals of the respective readout capacitors. Furthermore, the operational amplifier (operating as a comparator in the second mode of operation) sequentially converts the analog signal at the inverting input of the operational amplifier (which represents the difference between the reset value for a given pixel and the signal value for that pixel) into a digital value. The digital output register latches the digital value output during each sequential conversion until the analog-to-digital conversion is performed and the digital output value is stored in the register of each pixel sensor in the selected row. A new row is then selected and the pixel sensor outputs in the row are sequentially converted and stored in the digital registers using the same analog-to-digital converter and digital output register as described above.

[0025] According to a second aspect of the present disclosure, there is provided a digital imaging device comprising an analog-to-digital converter configured to sequentially select each row of a matrix of pixel sensors and operate the converter in a first mode and a second mode for each row, such that the analog-to-digital converter sequentially outputs digital values ​​representing a reset value minus a signal value for each pixel in the selected row before proceeding accordingly to the next row until digital values ​​have been output for all pixels in the matrix.

[0026] A single digital-to-analog converter and / or a single digital output register can be used to convert and store the output value of each pixel in the matrix.

[0027] Each pixel sensor may include four transistors per pixel sensor.

[0028] The digital imaging device may further include a pixel controller configured to control the pixel sensor to output a reset value during a first operating mode of the digital-to-analog converter and to output a signal value during a second operating mode of the digital-to-analog converter.

[0029] According to a third aspect of the present disclosure, there is provided a digital imaging system comprising a digital imaging device, the system further comprising an imaging controller, The imaging controller includes: in a first phase of operation, resetting each of the pixel sensors in a selected row and operating an analog-to-digital converter in a first mode of operation; and In a second phase of operation, the method is configured to operate the analog-to-digital converter in the first mode of operation and obtain a digital output from the analog-to-digital converter.

[0030] The imaging controller may be further configured to repeat the first and second phases for each row in the matrix.

[0031] The controller, the pixel controller, and / or the imaging controller may comprise the same controller. Alternatively, the controller, the pixel controller, and / or the imaging controller may be embodied by multiple different controllers.

[0032] The digital imaging system may further comprise a shift register coupled to the output of the analog-to-digital converter and configured to serialize data output from the analog-to-digital converter.

[0033] According to a fourth aspect of the present disclosure, there is provided a method of operating an analog-to-digital converter for a digital imaging device including a plurality of pixel sensors arranged in a two-dimensional matrix including a plurality of columns of pixel sensors, the analog-to-digital converter comprising: a plurality of readout capacitors, each readout capacitor being associated with a respective column of pixel sensors; an operational amplifier having an inverting input connected to the second terminals of the plurality of readout capacitors and a non-inverting input; a ramp signal source switchably connected to the non-inverting input of the operational amplifier. The method includes sequentially operating the analog-to-digital converter in a first mode of operation in which pixel sensors in a selected row of the pixel sensor matrix output reset values ​​and a second mode of operation in which pixel sensors in the selected row of the pixel sensor matrix output signal values; a. a first mode of operation includes connecting pixel sensor outputs of a selected row and each column in parallel with one another to first terminals of readout capacitors, and connecting an inverting input of an operational amplifier to a common reference voltage or to an output of the operational amplifier, such that the outputs of the pixel sensors in the row are read out in parallel and the reset values ​​of the pixel sensors in the row are stored on respective readout capacitors; b. A second operating mode disconnects the inverting input from the output of the operational amplifier or a reference voltage, so that the operational amplifier operates in a comparator mode, and sequentially connects the outputs of the pixel sensors in each column and selected row to first terminals of respective readout capacitors, while the second terminals of the readout capacitors are connected to the inverting input of the operational amplifier, and the non-inverting input of the operational amplifier is connected to a ramp signal source outputting a ramp reference voltage, and at the output of each sequentially connected pixel sensor, the value at the inverting input of the operational amplifier corresponds to the reset value stored on the respective readout capacitor minus the output signal of the pixel sensor in the respective column, and said value at the inverting input of the operational amplifier is provided as a digital output value encoded by the timing at which the output of the operational amplifier switches from one output extreme to the other output extreme.

[0034] According to a fifth aspect of the present disclosure there is provided a method of operating a digital imaging device including the steps of the method of the fourth aspect, comprising selecting in sequence each row of a matrix of pixel sensors and operating a converter in a first mode and a second mode for each row such that the analog to digital converter sequentially outputs a digital value representing a reset value minus a signal value for each pixel in the selected row before proceeding accordingly to the next row until digital values ​​have been output for all pixels in the matrix.

[0035] The method includes controlling pixel sensors in a selected row to output a reset value during a first operating mode of the analog-to-digital converter; The method may further include controlling pixel sensors in the selected row to output signal values ​​during a second operating mode of the analog-to-digital converter.

[0036] According to a sixth aspect of the present disclosure, there is provided a method of operating a digital imaging system comprising the steps of the method of the fifth aspect, comprising the steps of: resetting each pixel sensor in a selected row in a first phase of operation and operating the analog-to-digital converter in a first mode of operation; The method further includes operating the analog-to-digital converter in a second mode of operation during a second phase of operation and obtaining a digital output from the analog-to-digital converter.

[0037] According to a seventh aspect of the present disclosure there is provided a computer program configured to implement any of the methods of the fourth, fifth or sixth aspects.

[0038] According to an eighth aspect of the present disclosure there is provided a computer readable medium incorporating the computer program of the seventh aspect.

[0039] According to the present disclosure in a first example, there is provided an analog-to-digital converter for a digital imaging device with a plurality of pixel sensors arranged in a two-dimensional matrix. The analog-to-digital converter comprises a plurality of readout capacitors, an operational amplifier, and an output register. An output of each pixel sensor in each column of pixel sensors in the matrix is ​​associated with a respective readout capacitor. An output of each pixel sensor in each column of pixel sensors is connected to a respective addressable output switch. By operation of the respective output switch, the sensor value of the pixel sensor can be switchably output, when required, to a first terminal of a respective readout capacitor associated with the column to which the pixel belongs. An input of the operational amplifier is connected to a second terminal of each said readout capacitor. An inverting input of the operational amplifier is switchably connected to the output of the operational amplifier by a mode selection switch. In a first operating mode during the reset phase, the pixel sensor output is connected by a switch to a first terminal of a readout capacitor, the second terminal of which is connected to a common-mode reference or to the output of an operational amplifier connected to its inverting input, so that the operational amplifier operates in voltage follower mode and the value across the capacitor corresponds to the reset value of the pixel sensor. In a second mode during the imaging phase, the inverting input of the operational amplifier is disconnected from the output of the operational amplifier so that the operational amplifier operates in a comparator mode whereby any pixel sensor can be activated to output a signal to a respective capacitor, which is connected to the inverting output of the operational amplifier so that the value at the inverting input corresponds to the stored reset value minus the active pixel sensor output signal at the first terminal of the respective capacitor. The output of the active pixel sensor is provided as a digital output value encoded with the timing of the comparator output switching from one output extreme to the other output extreme in response to an analog ramp reference voltage at the non-inverting input of the operational amplifier crossing the voltage value at the inverting input.

[0040] In a development of the first example, an analogue to digital converter is provided, the analogue to digital converter further comprising a controller configured to sequentially connect each of the capacitors to an inverting output of the operational amplifier, and sequentially activate each pixel sensor connected to each respective capacitor to provide a series of digital output values ​​corresponding to each pixel sensor in the matrix in a predetermined sequence.

[0041] In a further development of the first example, the output of the operational amplifier is provided to an output register in synchronism with the sequential activation of the pixel sensors.

[0042] In a further development of the first example, an analog-to-digital converter is provided, the analog-to-digital converter further comprising a digital ramp analog-to-digital converter operating in a second mode of operation including an operational amplifier connected at one input to the readout capacitor and at another input to a predetermined ramp voltage signal.

[0043] In a further development of the first example, an apparatus is provided in which, in operation, for each row of the matrix, in turn, the addressable output switches are configured to switch sequentially connecting each column of the pixel sensor to a respective readout capacitor associated with that column and activating the pixel in the corresponding row and column for output to the respective readout capacitor before proceeding to the next row of the matrix, and the analog to digital converter is configured to sequentially output digital values ​​representing the charge present at the output of each pixel in a given row before proceeding accordingly to the next row of the matrix until values ​​have been output for all pixels in the matrix.

[0044] In a further development of the first example, each pixel sensor has four transistors per pixel sensor.

[0045] According to the present disclosure, in a second example, there is provided a digital imaging system including the apparatus according to the first example, the system further including a controller, the controller comprising: In a first phase of operation, resetting each pixel sensor in a selected row and connecting the output of each pixel sensor in the selected row to a respective readout capacitor associated with each pixel sensor; and In a second phase of operation, for each pixel sensor in the selected row, connecting the output of each pixel sensor in the selected row to an individual readout capacitor associated with each pixel sensor; Configured to capture digital output from an analog to digital converter.

[0046] In a second example development, the controller is further configured to repeat the first and second phases for each row of the matrix.

[0047] In a further development of the second example, the digital imaging system further comprises a shift register coupled to an output of each ADC and configured to serially convert the data outputs.

[0048] According to the present disclosure in a third example, there is provided a method of operating an analog-to-digital converter for a digital imaging device including a plurality of pixel sensors arranged in a two-dimensional matrix. The analog-to-digital converter includes a plurality of readout capacitors, an operational amplifier, and an output register. The output of each pixel sensor in each column of pixel sensors in the matrix is ​​associated with a respective readout capacitor. The output of each pixel sensor in each column of pixel sensors is connected to a respective addressable output switch, whereby the sensor value of the pixel sensor can be switchably output, when required, by operation of the respective output switch to a first terminal of a respective readout capacitor associated with the column to which the pixel belongs. An input of the operational amplifier is connected to a second terminal of each readout capacitor. An inverting input of the operational amplifier is switchably connected to the output of the operational amplifier by a mode selection switch. The method includes, in a first operating mode during a reset phase, connecting the inverting input of the operational amplifier to the output of the operational amplifier, such that the operational amplifier operates in a voltage follower mode, whereby a value across the capacitor corresponding to the reset value of the pixel sensor is stored as an output value of the operational amplifier. The method includes, in a second mode during an imaging phase, disconnecting an inverting input of the operational amplifier from an output of the operational amplifier such that the operational amplifier operates in a comparator mode; and The method includes the steps of receiving an output signal of an individual pixel sensor which is activatable to sequentially connect each capacitor to output a signal to each of said capacitors and providing said signal to a non-inverting input of an operational amplifier so that the value at the inverting input corresponds to the stored reset value minus the active pixel sensor output signal at the first terminal of each capacitor. The output of the active pixel sensor is provided as a digital output value encoded with the timing at which the comparator output switches from one output extreme to the other in response to an analog ramp reference voltage at the non-inverting input of the operational amplifier crossing the voltage value at the inverting input.

[0049] According to the present disclosure in a fifth example, there is provided a method of operating a digital imaging device including the steps of the third example, the method including the steps of: for each row of the matrix, sequentially switching addressable output switches to sequentially connect each column of pixel sensors to a respective readout capacitor associated with that column, and activating the pixels in the corresponding row and column for output to the readout capacitor before proceeding to the next row of the matrix, the analog to digital converter sequentially outputting digital values ​​representative of the charge present at the output of each pixel in a given row before proceeding accordingly to the next row until values ​​have been output for all pixels in the matrix.

[0050] In a fourth example development, the method further includes, in a first operational phase, resetting each pixel sensor in the selected row and connecting the output of each pixel sensor in the selected row to an individual readout capacitor associated with each pixel sensor, and, in a second operational phase, for each pixel sensor in the selected row, sequentially connecting the output of each pixel sensor in the selected row to an individual readout capacitor associated with each pixel sensor and capturing a digital output from the analog-to-digital converter.

[0051] According to the present disclosure in a fifth example, there is provided a computer program configured to implement the steps of either the third or fourth example.

[0052] According to a sixth embodiment of the present disclosure, there is provided a computer readable medium having embedded thereon the computer program of the fifth embodiment.

[0053] It is expressly intended that within the scope of this application, the various aspects, embodiments, examples and alternatives described in the preceding paragraphs, claims and / or the following description and drawings, in particular their individual features, can be employed independently or in any combination, i.e. all examples or aspects and / or features of any example or aspect can be combined in any way and / or combination, unless such features are incompatible. [Brief description of the drawings]

[0054] These and other advantages of the present invention will now be described with reference to the accompanying drawings.

[0055] [Figure 1a] 1 shows a first embodiment. [Figure 1b] A second embodiment is shown. [Diagram 2] 1 shows a possible implementation of the signal conditioning circuit described with reference to FIGS. 1a and 1b; [Diagram 3] 1a and 1b depict certain waveforms that may be detected during operation of the circuits. [Figure 4] Steps of a method of operating an ADC circuit according to one embodiment are presented. [Diagram 5] Method steps for operating a digital imaging device incorporating ADC circuitry according to one embodiment are presented. [Figure 6] Method steps for operating a digital imaging system incorporating a digital imaging device according to one embodiment are presented. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0056] An architecture of an analog-to-digital converter for digital imaging devices is provided that allows sharing of N columns coming from a pixel array. The parallel-serial architecture optimizes area and power consumption and is perfectly suited to the speed requirements of endoscope sensors. Figure 1a shows a first embodiment.

[0057] As shown in FIG. 1 a , a digital imaging system 1 is provided that includes a digital imaging device 10 that includes an ADC 100 .

[0058] As will become apparent from the following description, digital imaging system 1, digital imaging device 10, and ADC 100 may each constitute an embodiment.

[0059] The ADCs according to these embodiments address, among other things, the general objectives set forth above. 1. The ADC needs to be adapted to the extremely small pixel pitch. 2. The ADC area must be extremely small. 3. Digital output serialization also needs to reduce area. 4. ADC power consumption needs to be very low.

[0060] This is generally achieved by the embodiments described herein, which share an ADC across N columns, providing an architecture that is optimized for area and speed, since the reset sampling is done in parallel.

[0061] The presented architecture achieves these objectives since the N columns share the ADC, no additional sample-and-hold circuits or column decoders are required, CDS can be performed during conversion, and the ADCs are distributed along the array.

[0062] As shown in Fig. 1a, an analog-to-digital converter 100 for a digital imaging device is provided that includes a plurality of pixel sensors 151a, 152a arranged in a two-dimensional matrix 150 (including rows a, b and columns 151, 152 as shown). The pixel sensors themselves may include pixel sensors according to any suitable technology as would be expected by one skilled in the art, for example, 4T (four transistor) pixel shared SF, 6T (six transistor) pixel global shutter, 5T (five transistor) pixel, etc. As shown, the analog-to-digital converter 100 includes a plurality (110) of readout capacitors 111, 112 and an operational amplifier 120, where the output of each pixel sensor 151a, 152a in each column of pixel sensors in the matrix is ​​associated with an individual readout capacitor 111, 112. The output of each pixel sensor 151a, 152a in each column 151, 152 of pixel sensors is connected to a respective addressable output switch 101, 102 such that the sensor value of the pixel sensor 151a, 152a can be switchably output, as required, by operation of the respective output switch to a first terminal (e.g. the left terminal as shown) of a respective readout capacitor associated with the column to which the pixel belongs. The output signal may be conditioned by respective signal conditioning circuits 171, 172. Depending on the structure of the pixel circuit, suitable circuits may comprise simple current source circuits known to those skilled in the art, or more elaborate circuits as described below.

[0063] As shown, an inverting input 122 of an operational amplifier 120 is connected to a second terminal (e.g., the right terminal as shown) of each readout capacitor 111, 112. In the configuration of Figure 1a, the inverting input 122 is also switchably connected to the output of the operational amplifier by a mode selection switch 124. A non-inverting input 121 of the operational amplifier is switchably connected to a ramp signal source.

[0064] In a first operating mode during the reset phase, the inverting input of the operational amplifier is connected to the output of the operational amplifier (by closing the mode selection switch 124), so that the operational amplifier operates in a voltage follower mode and the capacitor value corresponding to the reset value of the pixel sensor is stored as the output value of the operational amplifier. This general operating mode of operational amplifiers is known to those skilled in the art, see for example the literature (Circuits Devices and Systems, Fourth Edition, Ralph J Smith, John Wiley and Sons, ISBN 0-471-805-16-5, page 441).

[0065] A particular advantage of this approach is that it provides auto-zero operation.

[0066] In this way, the ADC simultaneously samples the reset levels resulting from the pixel storage timing in the readout operation.

[0067] The converter therefore consists of N capacitors, each connected to a column of pixels to be sampled row by row. The other terminal of each capacitor is connected to an operational amplifier, which acts as a voltage follower amplifier when operating in closed loop when the converter is in the sampling reset phase. The amplifier then stores an offset in the capacitor simultaneously with sampling. This operation is known as autozero. The advantage of this approach is the reduction of the offset mismatch between the ADCs along the pixel array, which translates into a reduction of fixed pattern noise in the image. Another advantage of the autozero operation is the reduction of the low frequency noise of the amplifier.

[0068] In a second mode during the imaging phase, the inverting input of the operational amplifier is disconnected from the output of the operational amplifier (by opening the mode selection switch 124), so that the operational amplifier 120 operates in a comparator mode. This mode of operation is known to those skilled in the art, see for example the literature (Circuits Devices and Systems, Fourth Edition, Ralph J Smith, John Wiley and Sons, ISBN 0-471-805-16-5, page 445).

[0069] In this second mode, any pixel sensor is activated and outputs a signal to a respective capacitor, which is connected to the inverting input 122 of the operational amplifier so that the value at the inverting input corresponds to the stored reset value minus the active pixel sensor output signal at the first terminal of the respective capacitor. The output of the active pixel sensor is provided as a digital output value that is encoded with the timing of the comparator output switching from one output extreme to the other in response to, for example, an analog ramp reference voltage provided by ramp signal source 127 to the non-inverting input of the operational amplifier crossing the voltage value at the inverting input.

[0070] Based on this, the ADC may further comprise a digital ramp analog-to-digital converter including an operational amplifier operating in a second operating mode, connected at one input to the readout capacitor and at the other input to a predetermined ramp voltage signal provided, for example, by ramp signal source 127.

[0071] The signal levels coming from the pixels are thus read out sequentially and subtracted from the previously sampled reset in a process known as "correlated double sampling" (CDS) to ensure good image quality and low dark noise at the digitized output.

[0072] In the conversion phase, the amplifier works in an open loop and acts as a comparator. In this case, the pixel sets the output voltage on one terminal of the capacitor connected to the column and then shifts it to the other terminal according to the difference with the previously sampled reset level. By this subtraction, the ADC performs a CDS operation. At the other comparator terminal, the analog ramp reference starts to run and when it crosses the voltage level of vn, the comparator switches and a digital counter is sampled in the output register 30, as described below.

[0073] As mentioned above, the capacitors 111, 112, ... are selectively connected to pixel column values ​​on the one hand and to the operational amplifiers on the other hand by operation of the input and output switches. Coordinated control of these switches may be ensured by a controller 20 which in turn connects each capacitor to the inverting output of the respective operational amplifier and sequentially activates each pixel sensor connected to the respective capacitor to provide a series of digital output values ​​corresponding to each pixel sensor in the matrix in a predetermined sequence. This controller 20 may be a component of the ADC 100, the imager 10, or may be a component of a wider system 1 as shown.

[0074] The controller 20 can further be configured, in a first operating phase, to reset each pixel sensor in the selected row and connect the output of each pixel sensor in the selected row to an individual readout capacitor associated with each pixel sensor, and, in a second operating phase, to sequentially connect the output of each pixel sensor in the selected row to an individual readout capacitor associated with each pixel sensor, and capture a digital output from the analog-to-digital converter.

[0075] The controller 20 may further be configured to repeat the first and second phases for each row of the matrix.

[0076] The proposed structure is capable of performing CDS operation with extremely low noise because the reset values ​​of all pixels are stored in all capacitors, and the signal levels are converted with reference to the stored reset values, achieving true CDS and low noise.

[0077] To further improve the noise level, larger capacitors (capacitors with higher capacitance) and / or the number of bits of conversion can be used.

[0078] The system 1 or device 10 may further comprise an output register 30 connected to the output of the ADC (or to each ADC if multiple matrices with individual ADCs are provided) and configured to serialize the data output.

[0079] The ADC 100 may further comprise an output register 30 synchronized with the sequential activation of the pixel sensors. This output register may comprise a shift register, as a convenient mechanism for serializing the output of the ADC, whose length corresponds to the number of columns in a row or the number of pixels in a matrix. The values ​​of each flip-flop in the register may be read in parallel and written to memory, output for image processing, transferred to a second set of registers configured as a shift register to capture data for sequential output, etc., as required.

[0080] It may be noted that the matrix processed by the ADC may be one of multiple similar or identical matrices, each comprising an individual ADC as described above.

[0081] In one variation, the digital imaging device 10 may include an analog-to-digital converter 100 as described above, and may be configured such that in operation, for each row of the matrix, in turn, the addressable output switches are switched to sequentially connect each column of the pixel sensor to the respective readout capacitor associated with that column, and activate the corresponding row and column pixel for output to the respective readout capacitor before proceeding to the next row of the matrix, the analog-to-digital converter sequentially outputting digital values ​​representing the charge present at the output of each pixel in a given row before proceeding accordingly to the next row, until values ​​have been output for all pixels in the matrix.

[0082] Those skilled in the art will appreciate that the pixel sensor itself can be based on any convenient pixel sensor. Typical circuits include 4, 5 or 6 transistors per pixel. 4 transistors per pixel sensor may be particularly suitable.

[0083] FIG. 1b shows an alternative embodiment to that of FIG. 1a.

[0084] The system of Figure 1b is identical to that of Figure 1a, with correspondingly numbered elements being the same, but as shown, instead of providing a switch 124 as described with reference to Figure 1a, the circuit of Figure 1b provides for selectable connection of the inverting input of operational amplifier 123 to a reference voltage VRef in a first mode of operation, with the output of the operational amplifier being connected by closing mode selection switch 124, rather than the operational amplifier operating in a voltage follower mode, as described above with reference to Figure 1a. In a second mode of operation, the configuration is as described with respect to Figure 1a.

[0085] Thus, considering the embodiments of Figures 1a and 1b, in a first mode the pixel sensor output is connected by a switch to a first terminal of a readout capacitor, the second terminal of which is connected to a common reference (e.g. as described with reference to Figure 1b) or to the output of the operational amplifier and to the inverting input, such that the operational amplifier operates in a voltage follower mode (e.g. as described with reference to Figure 1b), and the value across the capacitor corresponds to the reset value of the pixel sensor.

[0086] It will be appreciated that while the approaches of Figures 1a and 1b have individual advantages, the approach of Figure 1a has the particular advantage of providing auto-zero operation which reduces column-to-column offset and low frequency noise.

[0087] It will be appreciated that any of the variations discussed above with respect to FIG. 1a can be applied mutatis mutandis to the approach of FIG. 1b.

[0088] FIG. 2 shows a possible implementation of the signal conditioning circuit described with reference to FIG. 1a or FIG. 1b.

[0089] As shown, circuit 200 includes a reset gate 210 including an enhancement mode N-channel MOSFET with no bulk connection, a TG gate 220 including an enhancement mode N-channel MOSFET with no bulk connection, a diode 230, a capacitor 240, an SF gate 250 including an enhancement mode N-channel MOSFET with no bulk connection, and a select gate 260 including an enhancement mode N-channel MOSFET with no bulk connection.

[0090] The drain of the reset gate 210 receives an input signal voltage from an individual pixel column output 151, 152. The source of the reset gate 210 is connected to the drain of the TG gate 220, one terminal of a capacitor 240 and a gate terminal of a select gate 260. The other terminal of the capacitor 240 is connected to ground. The source of the TG gate 220 is connected to the cathode of a diode 230. The anode of the diode 230 is connected to ground. The drain of the SF gate 250 is connected to a control signal SF. The SF gate 250 is connected to the drain of the select gate 260. The gate terminal of the select gate 260 is connected to a control signal SEL. The source terminal of the select gate 260 provides an output PIXOUT, which is fed to an individual addressable output switch 101, 102 as described with reference to Figure 1a or 1b.

[0091] In general, a circuit 200 provided at the output of each pixel column serves to control and regulate the output of each pixel column under the influence of control signals RS, TG, SF and SEL which are common to each such circuit within a given pixel matrix, as will become more apparent in the light of the following description.

[0092] The SF transistor is a source follower, which is essentially a buffer with a gain close to unity (about 0.85-0.9) and requires a current source at the bottom of the pixel array to act as a buffer. The purpose of this transistor is to put the voltage at its gate onto the output line. The source follower is connected to the output line by a SEL transistor acting as a switch. Only one SF can put data onto the column line, and for each row read, only one SEL transistor in the same column is active.

[0093] The photodiode is responsible for the accumulation of charge (electrons). When RS and TG (switches) are active, the photodiode is depleted, when TG is off, the exposure starts. The RS transistor resets the FD node to a high value when the readout starts, then it becomes inactive, we read the reset value (sample the capacitor), then TG becomes active, the electrons accumulated in the photodiode move to the FD, and the voltage at the FD moves according to the amount of electrons. In fact, the conversion from charge to voltage is given by the conversion gain CG (also known as CVF: charge to voltage factor).

[0094] FIG. 3 illustrates certain waveforms that may be detected during operation of the circuitry of one embodiment.

[0095] It should be noted that while FIG. 3 corresponds to a minimum case of two pixel columns corresponding to FIGS. 1a and 1b, the sequence can be extended to any desired number of columns, each sampled in the sequence as described below.

[0096] In particular, FIG. 3 presents waveforms that may be detected during operation for the control signals RS, TG and SEL.

[0097] During an exposure phase 301, the pixels of the pixel matrix are exposed to a light signal. After a predefined exposure period, a reset phase follows.

[0098] During the sampling reset phase, all phases are active and the operational amplifier mode is set to voltage follower operation by setting the operational amplifier mode control signal 124 high, as indicated at 302 .

[0099] The RST value of the pixel is then sampled onto the capacitors by setting the Sel and RS signals to logic high to close gates 210, 260 and enable the output of pixel signals for the current row of all columns of the pixel matrix, as shown by reference numeral 303. When the output voltage pixout rises, the respective sampling capacitors 101, 102 are charged by the pixel output, as shown by reference numeral 304.

[0100] Next, as shown by reference numeral 305, the sampling switches 111, 112 are closed by setting the value of the sampling capacitor output switches 111, 112 to a logic high.

[0101] Therefore, the inverting input of the operational amplifier is connected to the output of the operational amplifier, so that the operational amplifier operates in a voltage follower mode, and the value across the capacitor, which corresponds to the reset value of the pixel sensor, is stored as the output value of the operational amplifier.

[0102] Then the conversion phase for all pixels in the N columns begins for each pixel column in turn.

[0103] Once the reset value is read, a short positive pulse 306 on the transfer signal TG is made to transfer the charge from the photodiode to the FD.

[0104] For a given pixel column, the small pulse 311, 312, ..., 31N that sets the operational amplifier mode to a voltage follower configuration coincides with the closure of the individual sampling capacitor output switches 111, 112, ..., 11N for the column in question, setting the starting point to the common mode reference so that the parasitic capacitance of the circuit is charged to the same value at the beginning of the conversion. If this parasitic capacitance is not reset with every comparison, a memory effect from one conversion to the previous occurs. When the operational amplifier mode signal 124 returns to the comparator configuration, the individual sampling capacitor output switch 111 remains closed. During this period, the ramp connection signal operating switch 126 goes to logic high, closing switch 126 and exposing the non-inverting input 121 of the operational amplifier 120 to a ramp voltage signal that drops from a high reference voltage to zero at a nearly continuous rate. Meanwhile, the digital counter decrements from its maximum value to zero at a continuous rate so that it reaches zero at the same time that the lamp voltage reaches zero, causing the lamp connect signal to return to zero and disconnecting the non-inverting input 121 of operational amplifier 120 from the lamp voltage signal.

[0105] When the ramp input at the non-inverting input 121 crosses (represented by dotted line 307) the voltage at the inverting input 122 stored on the corresponding capacitor 111, 112, the output of the operational amplifier 120 switches from negative saturation to positive saturation. This switch initiates the transfer of the counter value at the time in question to the output register 130 as a digital representation of the analog value originally output by the pixel of the row and column currently under consideration.

[0106] Thus, each pixel sensor is sequentially activated and outputs a signal to a respective capacitor, which is connected to the inverting output of an operational amplifier such that the value at the inverting input corresponds to the stored reset value minus the active pixel sensor output signal at the first terminal of the respective capacitor. The output of the active pixel sensor is provided as a digital output value encoded with the timing at which the comparator output switches from one output extreme to the other in response to an analog ramp reference voltage at the non-inverting input of the operational amplifier crossing the voltage value at the inverting input.

[0107] As shown, the process goes back and initiates the next small pulse 311, 312, ..., 31N, with the set of outputs stored on capacitors 111, 112, repeating the previous steps for the next column, and so on, until all columns have been sampled.

[0108] The process is then repeated for the next row of pixels until all pixels in the matrix have been sampled, after which the process may be repeated for subsequent images.

[0109] In these waveforms, the control signals for a typical 4T pixel operating with a rolling shutter are also shown.

[0110] Those skilled in the art will understand that the presented details can be modified mutatis mutandis for other pixel architectures and other shutter modes. For example, if the pixel is a 6T global shutter pixel with a memory node, nothing changes. However, if the pixel is a 5T global shutter, we do a transfer first, then a reset. This means that the first value is the signal, and the second value is the reset value. The reset value is always higher than the signal value, so we may need to do an inverted analog ramp from low to high. In the current approach, it is from high to low. We believe the architecture remains unchanged.

[0111] Therefore, the ADC can simultaneously sample the reset levels resulting from pixel storage timing in the readout operation. Furthermore, the signal level coming from a given pixel is read out sequentially and subtracted from the previous sampled reset in a process known as "Correlated Double Sampling" (CDS), ensuring good image quality and low dark noise in the digitized output.

[0112] FIG. 4 presents steps of a method of operation of an ADC circuit according to one embodiment.

[0113] The embodiment may take the form of a method corresponding to the operations described above, particularly with reference to Figure 3. Figure 4 presents such a method.

[0114] Thus, there is provided a method of operating an analog-to-digital converter for a digital imaging device including a plurality of pixel sensors arranged in a two-dimensional matrix, the analog-to-digital converter including a plurality of readout capacitors, an operational amplifier, and an output register, the output of each pixel sensor in each column of pixel sensors in the matrix being associated with a respective readout capacitor, the output of each pixel sensor in each column of pixel sensors being connected to a respective addressable output switch, and the sensor value of the pixel sensor being switchably outputtable, when required, by operation of the respective output switch to a first terminal of a respective readout capacitor associated with the column to which the pixel belongs, wherein an input of the operational amplifier is connected to a second terminal of each readout capacitor, and an inverting input of the operational amplifier is switchably connected to the output of the operational amplifier by a mode selection switch.

[0115] The method begins at step 405 and proceeds to step 410 where a first row of the matrix is ​​selected. In step 410, in a first mode of operation during a reset phase, the inverting input of the operational amplifier is connected to the output of the operational amplifier so that the operational amplifier operates in a voltage follower mode, e.g., as described above, the value across the capacitor corresponding to the reset value of the pixel sensor is stored as the output value of the operational amplifier.

[0116] The method then proceeds to step 430, where in the second mode during the imaging phase, the inverting input of the operational amplifier is disconnected from the output of the operational amplifier so that the operational amplifier operates in a comparator mode. The method then proceeds to step 435, where the capacitor corresponding to the current column is connected to receive the output signal of the individual pixel sensor (which output can be activated accordingly by the larger system to which the ADC belongs). The method then proceeds to step 440, where it is determined whether the operational amplifier has toggled saturation. As known to those skilled in the art, there are many comparator-based ADC mechanisms, including direct conversion, successive evaluation, ramp comparison, Wilkinson, delta coding, etc., any of which may be adapted to the present invention. The determination of whether the operational amplifier has toggled is an indicator of the digital output value encoded by the timing of the comparator output switching from one output extreme to the other in response to the analog ramp reference voltage at the non-inverting input of the operational amplifier crossing the voltage value at the inverting input.

[0117] If the operational amplifier does not toggle saturation, the method loops at step 440 until it does. The method then proceeds to step 440 where an indicator of the digital value is provided as a digital output value encoded with the timing at which the comparator output toggles from one output extreme to the other in response to the analog ramp reference voltage at the non-inverting input of the operational amplifier crossing the voltage value at the inverting input. The method can then proceed to step 440 where this value can be output. The method then proceeds to step 445 where it is determined whether all pixel values ​​for the current row have been converted. If all pixel values ​​for the current row have not been converted, the method proceeds to step 450 where the next pixel in the current row is selected and then returns to step 430.

[0118] Thus, each capacitor is connected in sequence to receive the output signal of an individual pixel sensor, which can be activated to output a signal to the individual capacitor, providing a signal at the inverting output of the operational amplifier, such that the value at the inverting input corresponds to (the stored reset value) minus (the output signal of the activated pixel sensor at the first terminal of the individual capacitor), reflecting the output of the activated pixel sensor.

[0119] The method then optionally proceeds to step 455 where it is determined whether all rows in the matrix have been transformed. If all rows in the matrix have not been transformed, the method can proceed to step 460 where a new row is selected, otherwise the method ends at step 465.

[0120] It will be appreciated that the sequence of steps in Figure 4 may be rearranged without changing the underlying logic of the process. For example, steps 430 and 435 may be performed in any order.

[0121] FIG. 5 presents steps of a method of operating a digital imaging device incorporating an ADC circuit according to one embodiment.

[0122] The embodiment may take the form of a method corresponding to the operations described above, and in particular with reference to Figure 3. Figure 5 presents such a method.

[0123] The method of FIG. 5 corresponds substantially to the method of FIG. 4, with similarly numbered features corresponding thereto.

[0124] The method of Figure 5 relates to a method of operating a digital imaging device including the steps of the method of operating an analog to digital converter described above, where the digital imaging device incorporates the analog to digital converter described with respect to Figure 4. The method of operating a digital imaging device additionally includes step 533 immediately following step 430 for switching addressable output switches to connect a column of pixel sensors to the respective readout capacitors associated with that column and step, and step 538 immediately following step 535 for activating the corresponding row and column of pixels for output to the respective readout capacitors.

[0125] The addressable output switches are thus switched in sequence for each row of the matrix, sequentially connecting each column of the pixel sensor to the respective readout capacitor associated with that column, and before proceeding to the next row of the matrix, a pixel is activated in the corresponding row and column for output to the respective readout capacitor, such that the analog to digital converter sequentially outputs a digital value representing the charge present at the output of each pixel in a given row, before proceeding accordingly to the next row, until values ​​have been output for all pixels in the matrix.

[0126] It will be appreciated that the sequence of steps in Figure 5 may be rearranged without changing the underlying logic of the process. For example, steps 435, 536, and 538 may be performed in any order.

[0127] FIG. 6 presents steps in a method of operation of a digital imaging system incorporating a digital imaging device according to one embodiment.

[0128] The embodiment may take the form of a method corresponding to the operations described above, and in particular with reference to Figure 3. Figure 6 presents such a method.

[0129] The method of FIG. 6 corresponds substantially to the method of FIG. 4, with similarly numbered features corresponding thereto.

[0130] The method of FIG. 6 relates to a method of operating a digital imaging system that includes the steps of the method of operating the digital imaging device of FIG. 5, the system including the apparatus described with reference to FIG.

[0131] The method of operating a digital imaging system further includes, in a first operational phase, immediately prior to step 425, resetting each pixel sensor in the selected row, in step 611, and connecting the output of each pixel sensor in the selected row to an individual readout capacitor associated with each pixel sensor, in step 612.

[0132] The method of operating a digital imaging system further includes, in a second operational phase, connecting the activated pixel sensors to individual readout capacitors associated with each pixel sensor in step 637 between steps 536 and 538, and capturing a digital output from the analog-to-digital converter in step 441.

[0133] Thus, each pixel sensor in the selected row can be sequentially connected to the output of each pixel sensor in the selected row and to the individual readout capacitors associated with each pixel sensor.

[0134] Thus, prior art architectures provide one ADC element per column and include separate sampling elements for the reset and signal levels, whereas embodiments eliminate the separate signal level elements and use only one comparator per N columns, providing a very compact architecture while maintaining optimal levels of image quality in true CDS operation.

[0135] The embodiment can be implemented based on the 65nm node specific to CIS (Contact Image Sensor) technology.

[0136] The results obtained from these embodiments are presented in the table below and compared with implementations known from certain prior art circuits as follows: Example 1: M. Vatteroni, et al., "Smart optical CMOS sensor for endoluminal applications", Eurosensors XXIII, 2009. Example 2: M. Wany, et al., "Ultrasmall digital image sensor for endoscopic applications", in Proc. Int. Image Sensor Workshop, Jun. 2009, pp. 1-4. Example 3: S. Itoh, S. Kawahito, S. Terakawa,"A 2.6mW 2fps QVGA CMOS one-chip wireless camera with digital image transmission function for capsule endoscopes" Example 4: M. Wany, et al., "NanEye-An Endoscopy Sensor With 3-D Image Synchronization", IEEE sensors journal, 2017.

[0137] [Table 1]

[0138] It can be observed that implementations according to embodiments provide substantially superior overall performance, especially the best performance in terms of pixel rate and power consumption.

[0139] Thus, an analog to digital converter for a digital imaging device is provided, in which a column of pixels is sampled by individual capacitors.

[0140] In a reset phase of operation, each pixel in the row under consideration is reset and an operational amplifier operating in voltage follower mode is connected in parallel to all sampling capacitors to obtain a common reset value for the pixel sensors in that row. In an imaging phase of operation, after activating the individual pixel sensors, the inverting input of an operational amplifier operating in comparator mode is connected to each capacitor in turn while exposing the non-inverting signal to an analog ramp reference voltage, so that the timing of the switching of the operational amplifier reflects the value of the pixel under consideration, corrected for the reset value.

[0141] The disclosed implementations may take the form of an all-hardware embodiment, an all-software embodiment, for example with respect to the methods described above, or embodiments including both hardware and software elements. Software embodiments include, but are not limited to, firmware, resident software, microcode, etc. The present invention may take the form of a computer program product accessible from a computer usable or computer readable medium that provides program code for use by or in connection with a computer or instruction execution system. Computer usable or computer readable may be any apparatus that can store, store, communicate, propagate or transfer a program for use by or in connection with an instruction execution system, apparatus or device. The medium may be an electronic, magnetic, optical, electromagnetic, infrared or semiconductor system (or apparatus or device) or propagation medium.

[0142] These methods and processes may be implemented using computer application programs or services, application programming interfaces (APIs), libraries, and / or other computer program products, or any combination of such entities.

[0143] There is thus provided a program for a computer comprising instructions configured to implement the steps of a method of operating a charging device and / or a method of operating a reporting device as described above, or more generally, the operations described above, e.g. with respect to Figures 4 to 6.

[0144] It will be understood that the configurations and / or techniques described herein are exemplary in nature, and that these specific embodiments or examples are not to be considered in a limiting sense, as numerous variations are possible. The particular routines or methods described herein may represent one or more of any number of processing strategies. Thus, the various operations illustrated and / or described may be performed in the sequence illustrated and / or described, in other sequences, in parallel, or omitted. Similarly, the order of operations described above may be altered.

[0145] The subject matter of the present disclosure includes all novel and non-obvious combinations and sub-combinations of the various processes, systems, and configurations, as well as other features, functions, operations and / or properties disclosed herein, and any and all equivalents.

Claims

1. 1. An analog-to-digital converter for a digital imaging device having a plurality of pixel sensors arranged in a two-dimensional matrix including a plurality of columns of pixel sensors, comprising: a plurality of readout capacitors, each readout capacitor being associated with a respective column of pixel sensors; a first plurality of addressable output switches, each of the first plurality of addressable output switches configured to switchably connect an output of a pixel sensor in a column of the pixel sensor matrix to a first terminal of a readout capacitor associated with that column; an operational amplifier having an inverting input connected to the second terminals of the plurality of readout capacitors and a non-inverting input; a ramp signal source switchably connected to a non-inverting input of the operational amplifier, the ramp signal source configured to output a ramp reference voltage; a mode selection switch configured to switchably connect and disconnect the inverting input of the operational amplifier to a common reference voltage or to the output of the operational amplifier; a controller configured to control the addressable switches such that the analog-to-digital converter operates sequentially in a first mode of operation in which pixel sensors in selected rows of the pixel sensor matrix output reset values, and in a second mode of operation in which pixel sensors in selected rows of the pixel sensor matrix output signal values; a. in a first mode of operation, a first plurality of addressable output switches are closed, such that the pixel sensor outputs of a selected row and each column are simultaneously connected to a first terminal of a readout capacitor, and a mode selection switch is closed and an inverting input of the operational amplifier is connected to a common reference voltage or to the output of the operational amplifier, such that the outputs of the pixel sensors in the row are read out in parallel and the reset values ​​of the pixel sensors in the row are stored on individual readout capacitors; an analog-to-digital converter, wherein in a second mode of operation, the mode selection switch is open to disconnect the inverting input from the output of the operational amplifier or a reference voltage such that the operational amplifier operates in a comparator mode, and the first plurality of addressable output switches are sequentially closed to sequentially connect the output of the pixel sensor in each column and selected row to a first terminal of a respective readout capacitor while the second terminal of the readout capacitor is connected to the inverting input of the operational amplifier and the non-inverting input of the operational amplifier is connected to a ramp signal source, and the output of each pixel sensor is sequentially connected to the first terminal of its associated readout capacitor, wherein a value at the inverting input of the operational amplifier corresponds to a reset value stored on the respective readout capacitor minus an output signal of the pixel sensor in the respective column, and wherein said value at the inverting input of the operational amplifier is provided as a digital output value encoded by the timing at which the output of the operational amplifier switches from one output extreme to the other output extreme.

2. 2. The analog-to-digital converter of claim 1, wherein the output of the operational amplifier is provided to an output register synchronized with sequentially connecting the outputs of the pixel sensors in each column and selected row to the first terminals of respective readout capacitors.

3. A digital imaging device comprising the analog-to-digital converter according to any one of claims 1 to 2, 1. A digital imaging device configured to sequentially select each row of a matrix of pixel sensors and operate a converter in a first operating mode and a second operating mode for each row, such that the analog-to-digital converter is configured to sequentially output digital values ​​representing a reset value minus the signal value of each pixel in the selected row before proceeding accordingly to the next row, until digital values ​​have been output for all pixels in the matrix.

4. 4. The digital imaging device of claim 3, wherein each pixel sensor includes four transistors per pixel sensor.

5. 4. The digital imaging device of claim 3, further comprising a pixel controller configured to control the pixel sensor to output a reset value during a first operating mode of the analog-to-digital converter and to output a signal value during a second operating mode of the analog-to-digital converter.

6. 4. A digital imaging system comprising the apparatus of claim 3, the system further comprising an imaging controller, The imaging controller includes: in a first phase of operation, resetting each of the pixel sensors in a selected row and operating an analog-to-digital converter in a first mode of operation; and The digital imaging system is configured to operate the analog-to-digital converter in a second mode of operation and obtain a digital output from the analog-to-digital converter during a second phase of operation.

7. The digital imaging system of claim 6 , wherein the imaging controller is further configured to cycle between the first and second operational phases for each row in a matrix.

8. 7. The digital imaging system of claim 6, further comprising a shift register coupled to an output of the analog-to-digital converter and configured to serialize data output from the analog-to-digital converter.

9. 1. A method of operating an analog-to-digital converter for a digital imaging device including a plurality of pixel sensors arranged in a two-dimensional matrix including a plurality of columns of pixel sensors, comprising: The analog-to-digital converter comprises: a plurality of readout capacitors, each readout capacitor being associated with a respective column of pixel sensors; an operational amplifier having an inverting input connected to the second terminals of the plurality of readout capacitors and a non-inverting input; a ramp signal source switchably connected to the non-inverting input of the operational amplifier; The method includes sequentially operating an analog-to-digital converter in a first mode of operation in which pixel sensors in a selected row of a pixel sensor matrix output reset values ​​and a second mode of operation in which pixel sensors in a selected row of the pixel sensor matrix output signal values; a. a first mode of operation includes connecting pixel sensor outputs of a selected row and each column in parallel with one another to a first terminal of a readout capacitor, and connecting an inverting input of an operational amplifier to a common reference voltage or to an output of the operational amplifier, such that the outputs of the pixel sensors in the row are read out in parallel and the reset values ​​of the pixel sensors in the row are stored on individual readout capacitors; b. a second mode of operation disconnects the inverting input from the output of the operational amplifier or a reference voltage, such that the operational amplifier operates in a comparator mode, and sequentially connects the outputs of the pixel sensors in each column and selected row to first terminals of respective readout capacitors while second terminals of the readout capacitors are connected to the inverting input of the operational amplifier and the non-inverting input of the operational amplifier is connected to a ramp signal source outputting a ramp reference voltage, and at the output of each sequentially connected pixel sensor, the value at the inverting input of the operational amplifier corresponds to a reset value stored on the respective readout capacitor minus the output signal of the pixel sensor in the respective column, said value at the inverting input of the operational amplifier being provided as a digital output value encoded by the timing at which the output of the operational amplifier switches from one output extreme to the other output extreme.

10. 10. A method of operating a digital imaging device comprising the steps of the method of operating an analog-to-digital converter of claim 9, comprising the steps of: A method comprising: selecting each row of a matrix of pixel sensors in sequence, and operating a converter for each row in a first operating mode and a second operating mode, such that the analog-to-digital converter sequentially outputs a digital value representing a reset value minus a signal value for each pixel in the selected row before proceeding accordingly to the next row, until digital values ​​have been output for all pixels in the matrix.

11. 11. A method of operating a digital imaging device according to claim 10, comprising the steps of: controlling pixel sensors in a selected row to output a reset value during a first operation mode of the analog-to-digital converter; The method further includes controlling pixel sensors in the selected row to output signal values ​​during a second operating mode of the analog-to-digital converter.

12. 12. A method of operating a digital imaging system comprising the steps of the method of operating a digital imaging device of claim 11, comprising: in a first phase of operation, resetting each pixel sensor in a selected row and operating the analog-to-digital converter in a first mode of operation; The method further includes operating the analog-to-digital converter in a second mode of operation during a second phase of operation and obtaining a digital output from the analog-to-digital converter.

13. A computer program for causing a computer to execute any one of the methods of claims 9 to 12.

14. A computer readable medium embodied with the computer program of claim 13.

Citation Information

Patent Citations

  • Solid-state impage pickup element and adder

    JP1994205307A

  • Radiographic equipment

    JP2000165747A

  • Imaging element, imaging method, and electronic equipment

    JP2016012903A

  • Image sensor circuits including shared floating diffusion regions

    US20080308852A1