Imaging circuit with high frame rate edge detection

By introducing sub-pixels and subtraction circuits into the image sensor, and detecting edge information in the analog domain using in-pixel computing, the problem of inefficiency of traditional edge detection methods is solved, and edge image output at high frame rate and low power consumption are achieved.

CN119012033APending Publication Date: 2024-11-22SEMICON COMPONENTS IND LLC
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202410257384.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-05-19
Filing Date
2024-03-07
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

Traditional edge detection methods require reading the entire image and discarding most information that does not meet the edge conditions, resulting in inefficiency and being unable to achieve high frame rate edge image output.

Method used

By introducing sub-pixels and subtraction circuits into the image sensor, using in-pixel calculations to detect edge information in the simulation domain, an image sensor that extracts only edge information is realized. In-pixel subtraction and storage technology are used to perform edge detection in parallel across arrays, reducing Requirements for analog-to-digital conversion and digital processing.

Benefits of technology

Edge image output up to 100 frames per second or more is achieved, significantly improving readout speed and efficiency, reducing power consumption and avoiding unnecessary digital processing steps.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119012033A_ABST
    Figure CN119012033A_ABST
Patent Text Reader

Abstract

The invention relates to an imaging circuit with high frame rate edge detection. An image sensor may include an array of pixels arranged in rows and columns. Each pixel may include a sub-pixel circuit and one or more subtraction circuits. Each sub-pixel circuit may be selectively coupled to adjacent sub-pixel circuits in the same row via horizontal odd and even switches, and may be selectively coupled to adjacent sub-pixel circuits in the same column via vertical odd and even switches. The horizontal and vertical switches may be turned on in separate phases to store differences from adjacent subpixel pairs into the one or more subtraction circuits. These differences may be read out using a comparator and one or more shift registers to output an edge image including only edge information.
Need to check novelty before this filing date? Find Prior Art

Description

Background Art

[0001] Image sensors are often used in electronic devices such as mobile phones, cameras, and computers to capture images. In a typical arrangement, an image sensor includes an array of image pixels arranged into rows and columns of pixels. Circuitry can be coupled to each pixel column to read out an image signal from the image pixel.

[0002] It is against this background that the embodiments described herein arise. BRIEF DESCRIPTION OF THE DRAWINGS

[0003] Figure 1 is a diagram of an illustrative electronic device with an image sensor according to some embodiments.

[0004] Figure 2 is a diagram of an illustrative pixel array and associated row and column control circuits for reading out image signals from an image sensor, according to some implementations.

[0005] Figure 3 is a diagram of a typical image including details in every pixel.

[0006] Figure 4 is a diagram of an illustrative image that includes only edge information according to some embodiments.

[0007] Figure 5 is a circuit diagram showing two sub-pixels coupled to a subtraction circuit according to some embodiments.

[0008] Figure 6 is a diagram showing that according to some embodiments Figure 5 The timing diagram of the operation of the circuit shown in FIG.

[0009] Figure 7 is a circuit diagram showing a pixel array according to some embodiments, each pixel having a sub-pixel and two associated subtraction circuits.

[0010] Figure 8 is a diagram showing the first stage for calculating differences at even horizontal edges according to some embodiments.

[0011] Fig. 9 is a diagram illustrating a second stage for calculating differences at odd horizontal edges according to some embodiments.

[0012] Fig.10 is a diagram illustrating a third stage for computing differences at even vertical edges according to some embodiments.

[0013] Fig.11 is a diagram illustrating a fourth stage for computing differences at odd vertical edges according to some embodiments.

[0014] Fig.12 is configured according to some embodiments with Figures 7 to 11 Schematic diagram of an illustrative edge detection readout circuit operating in conjunction with a pixel array of the type shown in FIG.

[0015] Fig.13 is a diagram of an exemplary window comparator according to some embodiments.

[0016] Fig.14 is a diagram showing that according to some embodiments Fig.13 FIG. 5 is a graph of an exemplary distribution of pixels of a window comparator output for edge detection.

[0017] Fig.15 is a circuit diagram showing an array of pixels, each pixel having sub-pixels and an associated subtraction circuit, according to some embodiments.

[0018] Fig.16 is configured according to some embodiments with Fig.15 Schematic diagram of an illustrative edge detection readout circuit operating in conjunction with a pixel array of the type shown in FIG.

[0019] Fig.17 According to some embodiments, Figures 7 to 14 Flowchart of illustrative steps for implementing a pixel array of the type shown in FIG. DETAILED DESCRIPTION

[0020] Embodiments of the present invention technology relate to image sensors. It should be understood by those skilled in the art that exemplary embodiments of the present invention can be practiced without some or all of these specific details. In other cases, in order to avoid unnecessarily obscuring the embodiments of the present invention, well-known operations are not described in detail.

[0021] Electronic devices such as digital cameras, computers, cellular phones, and other electronic devices may include an image sensor that collects incoming light to capture an image. An image sensor may include an array of pixels. A pixel in an image sensor may include a photosensitive element, such as a photodiode, that converts the incoming light into an image signal. An image sensor may have any number (e.g., hundreds or thousands or more) of pixels. A typical image sensor may, for example, have hundreds or thousands or millions of pixels (e.g., megapixels). An image sensor may include control circuitry (such as circuitry for operating the pixels) and readout circuitry for reading out an image signal corresponding to the charge generated by the photosensitive element.

[0022] Figure 1 is a diagram of an illustrative imaging and response system including an imaging system that captures an image using an image sensor. Figure 1System 8 can be an electronic device such as a camera, a cellular phone, a video camera, or other electronic device that captures digital image data, can be a vehicle safety system (e.g., an active braking system or other vehicle safety system), can be a surveillance system, or can be part of an autonomous driving system.

[0023] like Figure 1 As shown, system 8 may include an imaging system, such as imaging system 10, and a host subsystem, such as host subsystem 20. Imaging system 10 may include camera module 12. Camera module 12 may include one or more image sensors 14, such as in an image sensor array integrated circuit, and one or more lenses.

[0024] During image capture operations, each lens may focus light onto an associated image sensor 14. Image sensor 14 may include light-sensitive elements (i.e., image sensor pixels) that convert light into analog data. An image sensor may have any number (e.g., hundreds, thousands, millions, or more) of pixels. A typical image sensor may, for example, have millions of pixels (e.g., several megapixels).

[0025] Each image sensor in camera module 12 may be identical, or different types of image sensors may be present in a given image sensor array integrated circuit. In some examples, image sensor 14 may also include bias circuitry (e.g., source follower load circuitry), sample and hold circuitry, correlated double sampling (CDS) circuitry, amplifier circuitry, data output circuitry, memory (e.g., buffer circuitry), and / or addressing circuitry.

[0026] Still image data and video image data from sensor 14 may be provided to image processing and data formatting circuitry 16 via path 28. Image processing and data formatting circuitry 16 may be used to perform image processing functions such as data formatting, adjusting white balance and exposure, implementing video image stabilization and / or facial detection. Image processing and data formatting circuitry 16 may additionally or alternatively be used to compress raw camera image files (e.g., to Joint Photographic Experts Group or JPEG format) if desired.

[0027] In one exemplary arrangement, such as a system-on-chip (SoC) arrangement, the sensor 14 and the image processing and data formatting circuitry 16 are implemented on a common semiconductor substrate (e.g., a common silicon image sensor integrated circuit die). If desired, the sensor 14 and the image processing circuitry 16 may be formed on separate semiconductor substrates. For example, the sensor 14 and the image processing circuitry 16 may be formed on separate substrates that have been stacked.

[0028] The imaging system 10 may transmit the acquired image data to a host subsystem 20 via a path 18. The host subsystem 20 may include input-output devices 22 and storage and processing circuitry 24. The host subsystem 20 may include processing software for detecting objects in an image, detecting motion of an object between image frames, determining distances to objects in an image, or filtering or otherwise processing images provided by the imaging system 10. For example, the image processing and data formatting circuitry 16 of the imaging system 10 may transmit the acquired image data to the storage and processing circuitry 24 of the host subsystem 20.

[0029] If desired, the system 8 can provide many advanced functions for the user. For example, in a computer or mobile phone, the user can be provided with the ability to run user applications. For these functions, the input-output device 22 of the host subsystem 20 may include a keyboard, input-output ports, buttons, and a display, as well as storage and processing circuits 24. The storage and processing circuits 24 of the host subsystem 20 may include volatile memory and / or non-volatile memory (e.g., random access memory, flash memory, hard disk drive, solid state drive, etc.). The storage and processing circuits 24 may additionally or alternatively include a microprocessor, a microcontroller, a digital signal processor, and / or an application-specific integrated circuit.

[0030] Figure 2 It is shown in Figure 1 An example of the arrangement of the image sensor 14 is shown in FIG. Figure 2 As shown, image sensor 14 may include control and processing circuitry 44. Control and processing circuitry 44 (sometimes referred to as control and processing logic) may be Figure 1 1 and 2. The image sensor 14 may include a portion of the image processing and data formatting circuitry 16 in the image sensor 14, or may be separate from the circuitry 16. The image sensor 14 may include an array of pixels, such as an array 32 of pixels 34 (sometimes referred to herein as image sensor pixels, imaging pixels, or image pixels). The control and processing circuitry 44 may be coupled to the row control circuitry 40 via control paths 27, and may be coupled to the column control and readout circuitry 42 via data paths 26.

[0031] Row control circuitry 40 may receive row addresses from control and processing circuitry 44 and may provide corresponding row control signals to image pixels 34 via one or more control paths 36. The row control signals may include pixel reset control signals, charge transfer control signals, overflow control signals, row select control signals, dual conversion gain control signals, or any other desired row pixel control signals.

[0032] Column control and readout circuitry 42 may be coupled to one or more columns of pixel array 32 via one or more conductors, such as column lines 38. A given column line 38 may be coupled to a column of image pixels 34 in image pixel array 32 and may be used to read out image signals from image pixels 34 and to provide bias signals (e.g., bias currents or bias voltages) to image pixels 34. In some examples, each column of pixels may be coupled to a corresponding column line 38. For image pixel readout operations, a row of pixels in image pixel array 32 may be selected using row driver circuitry 40, and image data associated with image pixels 34 of that pixel row may be read out on column lines 38 by column readout circuitry 42. Column readout circuitry 42 may optionally include column circuitry, such as a column amplifier for amplifying signals read out from array 32, a sample and hold circuit for sampling and storing signals read out from array 32, an analog-to-digital converter circuit for converting the readout analog signals into corresponding digital signals, and / or a column memory for storing the readout signals and any other desired data. Column control and readout circuitry 42 may output digital pixel readout values ​​via line 26 to control and processing logic 44 .

[0033] Array 32 may have any number of rows and columns. In general, the size of array 32 and the number of rows and columns in array 32 will depend on the specific implementation of image sensor 14. Although rows and columns are generally described herein as horizontal and vertical, respectively, rows and columns may refer to any grid-like structure. Features described herein as rows may be arranged vertically, and features described herein as columns may be arranged horizontally. The terms "rows" and "columns" referring to different sizes of array 32 may sometimes be used interchangeably.

[0034] Pixel array 32 may be provided with a color filter array having a plurality of color filter elements that allow a single image sensor to sample different colors of light. For example, an image sensor pixel, such as an image pixel in array 32, may be provided with a color filter array that allows a single image sensor to sample red, green, and blue light (RGB) using corresponding red, green, and blue image sensor pixels. The red, green, and blue image sensor pixels may be arranged in a Bayer mosaic pattern. The Bayer mosaic pattern consists of repeating cells of 2×2 image pixels, where two green image pixels are diagonally opposite to each other and adjacent to a red image pixel diagonally opposite to a blue image pixel. In another example, a broadband image pixel having a broadband color filter element (e.g., a transparent color filter element) may be used in place of a green pixel in a Bayer pattern. These examples are merely illustrative, and in general, color filter elements of any desired color (e.g., cyan, yellow, red, green, blue, etc.) and any desired pattern may be formed on any desired number of image pixels 34.

[0035] Conventionally, an image sensor may be used to acquire an image, wherein each pixel in the image includes a certain amount of information. Figure 3 is a diagram of a typical image 50 that includes a certain degree of detail in each pixel. Figure 3 As shown in , image 50 is a close-up image of a pinwheel. Each pixel in image 50 may include color and brightness information, showing texture, shadows, and highlights at the pinwheel surface, and also showing blurred details in the image background that is out of focus. The file size of image 50 depends directly on the overall size of the image array, which is a function of the number of rows and columns in the array. The readout speed of image 50 also depends on the necessary dynamic range of the image array, as time is required to perform the analog-to-digital conversion to convert the captured color and brightness information into digital values.

[0036] According to some embodiments, an image sensor 14 is provided that is configured to acquire an image that includes only edge information. Figure 4 is a diagram of an exemplary image 52 including only edge information. Figure 4 As shown in , image 52 shows only relevant details of the edges in the captured scene. For example, an "edge" may be defined as a boundary between two image regions where the color and / or brightness difference is high. Figure 4 In the example of , image 52 shows only white pixels or gray pixels at some of the more detectable or discernible edges of the pinwheel, while the rest of image 52 is completely black. Such an image 52 that includes only edge information is sometimes referred to as, and is defined herein as, an "edge image." Although Figure 3 The image 50 may be a color image, but the edge image 52 may be a grayscale (or monochrome) image.

[0037] As shown in edge image 52, edge information is relatively sparse because most of the content in most images is not edges. Traditional edge detection schemes read an entire image such as image 50, process the image 50, and then discard the vast majority of image information that does not meet the edge condition. This traditional method of generating edge images is extremely wasteful and has limited throughput. Therefore, it is desirable to provide an improved method for generating edge images.

[0038] According to some embodiments, an image sensor 14 is provided that is capable of generating an edge image by extracting only edge information (e.g., only edges have non-zero readout values ​​and non-edges have zero readout values). The edge information can be detected in the analog domain by using intra-pixel calculations (e.g., using intra-pixel subtraction and storage). This technique of extracting and calculating only edge information in the analog domain is technically advantageous and beneficial because it enables extremely high frame rate readout schemes with minimal or no analog-to-digital conversion and additional digital processing. For example, the techniques disclosed herein can enable edge images to be output at more than 100 frames per second (fps), more than 500fps, 500fps to 1000fps, or more than 1000fps.

[0039] To support the extraction of edge information, an image pixel may include a sub-pixel portion and an intra-pixel subtraction portion. Figure 5 is a circuit diagram showing two sub-pixel circuits 60-1 and 60-2 coupled to a subtraction circuit 62. Figure 5 As shown in , each subpixel circuit 60 (e.g., subpixel 60-1 and subpixel 60-2) may include a photosensitive element such as a photodiode PD, a global shutter switch such as a global shutter transistor GS, a charge transfer switch such as a charge transfer transistor TX, a reset switch such as a reset transistor RST, a source follower such as a source follower transistor SF, and a row selection switch such as a row selection transistor SEL.

[0040] The global shutter transistor GS may have a drain terminal coupled to a positive power supply line (e.g., a power supply terminal provided with a positive power supply voltage Vdd), a source terminal coupled to the cathode of the photodiode PD, and a gate terminal configured to receive a global shutter control signal. When referring to the conductive terminals of a metal oxide semiconductor transistor, the terms "source" and "drain" are sometimes used interchangeably. The source and drain terminals are therefore sometimes referred to as "source-drain" terminals (e.g., a transistor has a gate terminal, a first source-drain terminal, and a second source-drain terminal). The photodiode PD may have an anode terminal coupled to a ground line (e.g., a ground power supply line provided with a ground voltage Vss).

[0041] The charge transfer transistor TX may have a first source-drain terminal coupled to the cathode of the photodiode PD, a second source-drain terminal coupled to the floating diffusion node (region) FD, and a gate terminal configured to receive a transfer gate control signal. The reset transistor RST may have a drain terminal coupled to the positive power supply voltage Vdd, a source terminal coupled to the floating diffusion node FD, and a gate terminal configured to receive a reset signal. The source follower transistor SF may have a gate terminal coupled to the floating diffusion node FD, a drain terminal coupled to the positive power supply voltage Vdd, and a source terminal. The row selection transistor SEL may have a drain terminal coupled to the source terminal of the source follower SF, a gate terminal configured to receive a row selection control signal, and a source terminal coupled to the input node Sub_in of the subtraction circuit 62. The pixel structure of the sub-pixels 60-1 and 60-2 may have such a structure, which is exemplary. If necessary, each sub-pixel circuit 60 may include more or less switches, one or more capacitors, one or more storage gates, one or more storage nodes, and / or other pixel-level imaging components.

[0042] The subtraction circuit 62 may include a precharge switch (such as precharge transistors PC and PC_sub), a capacitive component (such as capacitors C1, C2 and C3), a reset switch (such as a subtraction circuit reset transistor RST_sub), a source follower (such as a subtraction circuit source follower transistor SF_sub), a row selection switch (such as a subtraction circuit row selection transistor SEL_sub), a capacitor selection switch (such as a capacitor selection transistor SEL_cap), another source follower (such as an output circuit source follower transistor SF_out), and another source row selection switch (such as an output circuit row selection transistor SEL_out).

[0043] The precharge transistor PC may have a drain terminal coupled to the input node Sub_in, a source terminal coupled to another ground line (e.g., a precharge line provided with a precharge voltage Vprech), and a gate terminal configured to receive a first precharge control signal. The precharge voltage Vprech may be equal to or different from the ground voltage Vss. The capacitor C2 may have a first terminal coupled to the input node Sub_in and a second terminal configured to receive the precharge voltage Vprech. The capacitor C1 may have a first terminal coupled to the input node Sub_in, and a second terminal. The transistor RST_sub may have a drain terminal coupled to another positive power line (e.g., a positive power terminal provided with a positive power voltage Vdd_sub), a source terminal coupled to the second terminal of C1, and a gate terminal configured to receive another reset control signal. The power supply voltage Vdd_sub may be the same as or different from the sub-pixel power supply voltage Vdd.

[0044] The transistor SF_sub may have a drain terminal coupled to another positive power supply line (e.g., a positive power supply terminal provided with a positive power supply voltage Vdd_sub_sf), a source terminal, and a gate terminal coupled to the second terminal of the capacitor C1. The power supply voltage Vdd_sub_sf may be equal to or different from Vdd or Vdd_sub. The transistor SEL_sub may have a drain terminal coupled to the source terminal of the transistor SF_sub, a source terminal, and a gate terminal configured to receive another selection signal. The transistor PC_sub may have a drain terminal coupled to the source terminal of the transistor SEL_sub, a source terminal coupled to another ground line (e.g., a precharge line provided with a precharge voltage Vprech_sub), and a gate terminal configured to receive another precharge control signal. The precharge voltage Vprech_sub may be equal to or different from the ground voltage Vss or the precharge voltage Vprech.

[0045] The transistor SEL_cap may have a drain terminal coupled to the drain terminal of the transistor PC_sub, a gate terminal configured to receive a capacitor selection control signal, and a source terminal coupled to the capacitor C3. The capacitor C3 may have a first terminal coupled to the transistor SEL_cap and a second terminal coupled to another ground line (e.g., a ground power line provided with a ground voltage Vmim). The capacitor C3 is sometimes referred to as a storage capacitor or a memory capacitor. The voltage Vmim may be equal to or different from Vss, Vprech, or Vprech_sub.

[0046] The transistor SF_out may have a drain terminal coupled to another positive power supply line (e.g., a positive power supply terminal provided with a positive power supply voltage Vdd_out), a source terminal, and a gate terminal coupled to the source terminal of the transistor SEL_sub. The power supply voltage Vdd_out may be equal to or different from Vdd, Vdd_sub, or Vdd_sub_sf. The transistor SEL_out may have a drain terminal coupled to the source terminal of the transistor SF_out, a gate terminal configured to receive another selection signal, and a source terminal coupled to the subtraction circuit output port Out. Figure 5 The structure of subtraction circuit 62 shown in FIG. 6 is exemplary. If desired, subtraction circuit 62 may include more or fewer switches, one or more capacitors, one or more storage nodes, and / or other components.

[0047] Figure 6 is a diagram showing that according to some embodiments Figure 5 The timing diagram of the operation of the circuit shown in FIG.

[0048] TX1 may refer to the charge transfer transistor of the first sub-pixel 60-1, and TX2 may refer to the charge transfer transistor of the second sub-pixel

[0049] SEL1 may refer to a row select transistor of the first sub-pixel 60-1, and SEL2 may refer to a row select transistor of the second sub-pixel 60-2. RST1 may refer to a reset transistor of the first sub-pixel 60-1, and RST2 may refer to a reset transistor of the second sub-pixel 60-2.

[0050] From time t1 to t2, reset transistor RST1 and reset transistor RST2 can be turned on (activated) to reset the floating diffusion nodes of the two sub-pixels to a reset value. This time period is sometimes referred to as a reset phase. Unlike conventional correlated double sampling (CDS) readout, the reset value is independent of edge detection. The reset values ​​of both sub-pixel 60-1 and sub-pixel 60-2 can be ignored (e.g., edge detection does not require high accuracy).

[0051] At time t2, transistors RST1 and RST2 are turned off (deactivated), while charge transfer transistor TX1, reset transistor RST_sub and precharge transistor PC are all turned on. During this period, the accumulated charge in sub-pixel 60-1 is transferred to its FD node, while node Sub_in is precharged to Vprech, and at the same time, the storage node in subtraction circuit 62 is reset by transistor RST_sub.

[0052] At time t3, transistors TX1 and PC are turned off, while transistor SEL1 is turned on. During this period, the image signal from the first subpixel 60-1 is read out and sampled at the input of the subtraction circuit 62. The time period from time t3 to time t4 is therefore sometimes referred to as the first sampling phase.

[0053] At time t4, transistors SEL1 and RST_sub are turned off (deactivated), while charge transfer transistor TX2 and precharge transistor PC are turned on. During this period, the accumulated charge in sub-pixel 60-2 is transferred to its FD node, and node Sub_in is precharged to Vprech. Since transistor RST_sub is turned off, the right terminal of capacitor C1 is in an electrically floating state, so the voltage across capacitor C1 does not change during this period. Therefore, even if the left terminal of capacitor C1 is precharged to Vprech, the previous sampled value for the first sub-pixel 60-1 is still stored at both ends of capacitor C1. At this time, the difference between the first sampled value and the second sampled value can be sampled at both ends of capacitor C1. Therefore, capacitor c1 is sometimes referred to as a sampling capacitor. Circuit 62 operating in this manner effectively utilizes the CDS scheme to subtract the image signal read out from the two sub-pixel portions. In other words, circuit 62 can be used to perform intra-pixel subtraction in the analog domain, which is the basic calculation required for fast edge detection.

[0054] At time t5, transistors TX2 and PC are turned off, while transistor SEL2 is turned on. Transistors SEL_cap and PC_sub are also turned on at time t5. During this period, the image signal from the second sub-pixel 60-2 can be read out and sampled at the input of the subtraction circuit 62. The time period from time t5 to time t6 is therefore sometimes referred to as the second sampling phase. Turning on transistors SEL_cap and PC_sub during the second sampling phase resets the charge on the storage capacitor C3 to Vprech_sub.

[0055] At time t6, transistors SEL2 and PC_sub are turned off, while transistor SEL_sub is turned on. The turned-on transistor SEL_sub reads the difference and stores the difference on storage capacitor C3. Therefore, the period from time t6 to t7 is sometimes referred to as the difference storage phase.

[0056] Two adjacent sub-pixels may be coupled to corresponding subtraction circuits in the horizontal direction and the vertical direction to perform a continuous network of subtraction or difference operations. Figure 7 is a circuit diagram showing an array of pixels 34, each pixel having one subpixel 60 and two associated subtraction circuits, such as horizontal subtraction circuit 62-H and vertical subtraction circuit 62-V. In general, the term "pixel" may refer to or be defined herein as a pixel circuit that includes one or more subpixel portions 60 and one or more subtraction circuit portions 62. Figure 7 The example of FIG. 4 shows a first row of pixels 34 having sub-pixels 60 - 1 and 60 - 2 and a second row of pixels 34 having sub-pixels 60 - 3 and 60 - 4 .

[0057] Figure 7The sub-pixels 60-1 and 60-2 in the first row of the graph may be coupled to the first horizontal (row) signal line 72-1, while Figure 7 The sub-pixels 60-3 and 60-4 in the second row in the horizontal (row) signal line 72-2 can be coupled to the second horizontal (row) signal line 72-2. The horizontal signal line 72-1 can be selectively coupled to the input node of the horizontal subtraction circuit 62-H in the pixels of the first row via the switch horz_even and the switch horz_odd (e.g., the horz_even switch and the horz_odd switch are arranged alternately along the line 72-1). Similarly, the horizontal signal line 72-2 can be selectively coupled to the input node of the horizontal subtraction circuit 62-H in the pixels of the second row via the switch horz_even and the switch horz_odd (e.g., the horz_even switch and the horz_odd switch are arranged alternately along the line 72-2). Specifically, each subtraction circuit 62-H in the odd column can be coupled to the adjacent subtraction circuit 62-H in the corresponding even column via the even horizontal switch horz_even, and each subtraction circuit 62-H in the even column can be coupled to the adjacent subtraction circuit 62-H in the corresponding odd column via the odd horizontal switch horz_odd.

[0058] Figure 7 The sub-pixels 60-1 and 60-3 in the column row in can be coupled to the first vertical (column) signal line 70-1, while Figure 7 The sub-pixels 60-2 and 60-4 in the second column of can be coupled to the second vertical (column) signal line 70-2. The vertical signal line 70-1 can be selectively coupled to the input node of the vertical subtraction circuit 62-V in the pixel of the first column via the switch vert_even and the switch vert_odd. Similarly, the vertical signal line 70-2 can be selectively coupled to the input node of the vertical subtraction circuit 62-V in the pixel of the second column via the switch vert_even and the switch vert_odd. Specifically, each subtraction circuit 62-V in the odd row can be coupled to the adjacent subtraction circuit 62-V in the corresponding even row via the even vertical switch vert_even, and each subtraction circuit 62-V in the even row can be coupled to the adjacent subtraction circuit 62-V in the corresponding odd row via the odd vertical switch vert_odd. In other words, the vert_even and vert_odd switches can be alternately arranged along the vertical signal column lines 70-1 and 70-2.

[0059] shows a 2×2 array of four pixels 34 Figure 7The array is illustrative and can be repeated in the row direction and the column direction. In general, the image sensor may include pixels 34 arranged in any number of rows and any number of columns (e.g., the image sensor array may include hundreds or thousands of rows and hundreds or thousands of columns). Each row of pixels may be coupled to a horizontal (row) signal line 72, wherein interspersed horz_even and horz_odd switches selectively couple adjacent subtraction circuits 62-H together. Each column of pixels may be coupled to a vertical (column) signal line 70, wherein interspersed vert_even and vert_odd switches selectively couple adjacent subtraction circuits 62-V together. The horizontal switches and vertical switches may be driven in a hot-only manner (e.g., only one of the switches horz_even, horz_odd, vert_even, and vert_odd may be activated at any point in time).

[0060] Figure 7 A pixel array of the type shown in can be configured to perform a global difference and store operation by executing a continuous subtraction network with moving boundaries via a four-stage operation. Figure 8 is a diagram showing the first stage for computing the difference at the even horizontal edges of the network. Figure 8 As shown in , the horz_odd switch can be turned on (activated) to couple the associated adjacent sub-pixels together (e.g., to calculate differences around all horizontal even edges and store the resulting differences in the memory capacitor of the right subtraction circuit 62-H in each pixel pair). For example, from Figure 8 The first pixel value of the sub-pixel 60-1 in the first row and the Figure 8 The second pixel value of the sub-pixel 60-2 in the first row can be coupled to the subtraction circuit 62-H' associated with the right sub-pixel 60-2, and the difference between the first pixel value and the second pixel value will be stored in the subtraction circuit 62-H'. Figure 8 The third pixel value of the sub-pixel 60-3 in the first row and the value from Figure 8 The fourth pixel value of the sub-pixel 60-4 in the second row can be coupled to the right subtraction circuit 62-H" associated with the sub-pixel 60-4, and the difference between the resulting third pixel value and the fourth pixel value will be stored in the subtraction circuit 62-H". This intra-pixel subtraction and difference storage scheme can be repeated across the array in a parallel manner.

[0061] Fig. 9 is a diagram showing the second stage for computing the differences at the odd horizontal edges of the network. Fig. 9As shown in , the horz_even switch can be turned on (activated) to couple the associated adjacent sub-pixels together (e.g., to calculate the difference around all horizontal odd edges and store the resulting difference in the memory capacitor of the right subtraction circuit 62-H in each pixel pair). For example, from Fig. 9 The first pixel value of the sub-pixel 60-2 in the first row and the Fig. 9 The second pixel value of the sub-pixel 60-3 in the first row can be coupled to the subtraction circuit 62-H' associated with the right sub-pixel 60-3, and the difference between the first pixel value and the second pixel value will be stored in the subtraction circuit 62-H'. Fig. 9 The third pixel value of the sub-pixel 60-2' in the second row and the value from Fig. 9 The fourth pixel value of the sub-pixel 60-3' in the second row can be coupled to the right subtraction circuit 62-H" associated with the sub-pixel 60-3', and the difference between the resulting third pixel value and the fourth pixel value will be stored in the subtraction circuit 62-H". This intra-pixel subtraction and difference storage scheme can be repeated across the array in a parallel manner.

[0062] Fig.10 is a diagram showing the third stage for computing the difference at the even vertical edges of the network. Fig.10 As shown in , the vert_odd switch can be turned on (activated) to couple the associated adjacent sub-pixels together (e.g., to calculate differences around all vertical even edges and store the resulting differences in the memory capacitor of the lower subtraction circuit 62-V in each pixel pair). For example, from Fig.10 The first pixel value of the sub-pixel 60-1 in the first column and the Fig.10 The second pixel value of the sub-pixel 60-1' in the first column can be coupled to the lower subtraction circuit 62-V' associated with the sub-pixel 60-1', and the difference between the first pixel value and the second pixel value will be stored in the subtraction circuit 62-V'. Fig.10 The third pixel value of the sub-pixel 60-2 in the second column and the value from Fig.10 The fourth pixel value of the sub-pixel 60-2' in the second column can be coupled to the lower subtraction circuit 62-V" associated with the sub-pixel 60-2', and the difference between the resulting third pixel value and the fourth pixel value will be stored in the subtraction circuit 62-V". This intra-pixel subtraction and difference storage scheme can be repeated across the array in a parallel manner.

[0063] Fig.11 is a diagram showing the fourth stage for computing the difference at the odd vertical edges of the network. Fig.11As shown in , the vert_even switch can be turned on (activated) to couple the associated adjacent sub-pixels together (e.g., to calculate the difference around all vertical odd edges and store the resulting difference in the memory capacitor of the lower subtraction circuit 62-V in each pixel pair). For example, from Fig.11 The first pixel value of the sub-pixel 60-1' in the first column and the first pixel value of the sub-pixel 60-1' in the first column Fig.11 The second pixel value of the sub-pixel 60-1″ in the first column can be coupled to the subtraction circuit 62-V′ associated with the lower sub-pixel 60-1″, and the difference between the first pixel value and the second pixel value will be stored in the subtraction circuit 62-V′. Fig.11 The third pixel value of the sub-pixel 60-2' in the second column and the value from Fig.11 The fourth pixel value of the sub-pixel 60-2" in the second column can be coupled to the subtraction circuit 62-V" associated with the lower sub-pixel 60-2", and the difference between the resulting third pixel value and the fourth pixel value will be stored in the subtraction circuit 62-V". This intra-pixel subtraction and difference storage scheme can be repeated across the array in a parallel manner.

[0064] Can be executed in any order Figures 8 to 11 The four stages shown in FIG. 1 are repeated until the subtraction (difference) values ​​from all horizontally adjacent sub-pixels and all vertically adjacent sub-pixels have been stored in the corresponding memory capacitors of each horizontal subtraction circuit 62-H and each vertical subtraction circuit 62-V (see, for example, Figure 5 In C3). If necessary, the subtraction values ​​around the horizontal odd edges can be calculated before the horizontal even edges. If necessary, the subtraction values ​​around the vertical odd edges can be calculated before the vertical even edges. If necessary, the subtraction values ​​of the vertical edges can be calculated before the horizontal edges.

[0065] Fig.12 is configured according to some embodiments with Figures 7 to 11 FIG. 1 is a diagram of an exemplary edge detection readout circuit operating with a pixel array 34 of the type shown in FIG. Fig.12 As shown in , the edge detection readout circuit may include a plurality of comparator circuits such as a horizontal comparator 82H and a vertical comparator 82V, voltage buffers such as a reference voltage buffer 80-1 and a reference voltage buffer 80-2, shift register circuits such as a horizontal shift register 84H and a vertical shift register 84V, and logic gates such as a logic OR gate 86. The voltage buffer 80-1 may be configured to output (drive) a high reference voltage Vref_hi, and the voltage buffer 80-2 may be configured to output (drive) a low reference voltage Vref_lo.

[0066] Each horizontal comparator 82H may have a first input terminal configured to receive a difference value from a plurality of subtraction circuits 62-H in a sequential manner, a second input terminal configured to receive a reference voltage Vref_hi from a voltage buffer 80-1, a third input terminal configured to receive a reference voltage Vref_lo from a voltage buffer 80-2, and an output terminal coupled to a corresponding register in the horizontal shift register 84H. Configured in this manner, each horizontal comparator 82H may receive a stored difference value, a reference voltage Vref_hi, and a reference voltage Vref_lo from a subtraction circuit 62-H in a corresponding column. Each vertical comparator 82V may have a first input terminal configured to receive a difference value from a plurality of subtraction circuits 62-V in a sequential manner, a second input terminal configured to receive a reference voltage Vref_hi from a voltage buffer 80-1, a third input terminal configured to receive a reference voltage Vref_lo from a voltage buffer 80-2, and an output terminal coupled to a corresponding register in the vertical shift register 84V. Configured in this manner, each vertical comparator 82V may receive the stored difference value, the reference voltage Vref_hi, and the reference voltage Vref_lo from the subtraction circuit 62 -V in the corresponding column.

[0067] The logic OR gate 86 may have a first input coupled to the output of the horizontal shift register 84H and a second input coupled to the output of the vertical shift register 84V. Configured in this manner, the comparator output values ​​from the shift register 84H and the shift register 84V can be shifted out in a locked stepping manner, and the logic OR gate 86 outputting a logic "1" will indicate the presence of a detected edge, while the outputting a logic "0" will indicate that no edge has been detected. Each pixel 34 may contain two bits of information (e.g., one horizontal edge and one vertical edge). For edge detection, a single output bit in each direction is sufficient. Detecting and reading out edge information in this manner does not require any high-resolution analog-to-digital converters and complex digital processing, so operations up to 1000 frames per second or more can be achieved.

[0068] Fig.13 is a diagram of an exemplary comparator 82 according to some embodiments. Fig.13 The comparator 82 can represent Fig.12 The horizontal comparator 82H and / or the vertical comparator 82V are as shown in FIG. Fig.13As shown, the comparator 82 may include a first comparator such as a comparator subcircuit 90, a second comparator such as a comparator subcircuit 92, and a logic gate such as a logic NAND gate 94. The comparator subcircuit 90 may include a first (positive) input terminal configured to receive a high reference voltage Vref_hi, a second (negative) input terminal configured to receive a subtraction value Vsub from a subtraction circuit (e.g., from the subtraction circuit 62-H or 62-V), and an output terminal coupled to the logic NAND gate 94. The comparator subcircuit 92 may include a first (positive) input terminal configured to receive a subtraction value Vsub, a second (negative) input terminal configured to receive a low reference voltage Vref_lo, and an output terminal coupled to the logic NAND gate 94. The logic NAND gate 94 may be configured to generate a comparator output signal comp_out at its output terminal.

[0069] Fig.14 It shows that it can be Fig.13 A diagram of an exemplary distribution of pixels for edge detection output by the comparator 82. The voltage levels of the reference voltages Vref_lo and Vref_hi should be selected so that most pixel outputs will belong to the "non-edge" category, while the first small number of pixels below Vref_lo will be classified as "edge", and the second small number of pixels below Vref_hi will also be classified as "edge". Any Vsub value below the reference voltage Vref_lo will generate a corresponding comparator output signal comp_out equal to logic 1. Any Vsub value above the reference voltage Vref_hi will generate a corresponding comparator output signal comp_out also equal to logic 1. Any Vsub value greater than Vref_lo and less than Vref_hi will generate a corresponding comparator output signal comp_out equal to logic 0. A comparator 82 configured and operated in this manner is sometimes referred to as a window comparator. Such a window comparator 82 can replace a high-resolution ADC in an image sensor, which can significantly increase the readout speed while maintaining low power consumption.

[0070] Fig.17 Is used for operation Figures 7 to 14 1. In operation at block 100, charge may be accumulated in the array of pixels 34 in response to impinging photons. In operation at block 102 (sometimes referred to as the first stage), the horizontal odd switch horz_odd may be activated to store the difference from the first adjacent subpixel pair in each row in the first portion of the horizontal subtraction circuit 62-H. This is done in Figure 8, where a first difference value associated with subpixels 60-1 and 60-2 is stored in horizontal subtraction circuit 62-H', and where a second difference value associated with subpixels 60-3 and 60-4 is stored in horizontal subtraction circuit 62-H'. This subtraction scheme may be repeated across the array for the remaining columns and all rows.

[0071] In the operation of block 104 (sometimes referred to as the second stage), the horizontal even switch horz_even may be activated to store the difference values ​​from the second adjacent pair of subpixels in each row in the second portion of the horizontal subtraction circuit 62-H. Fig. 9 , where the difference value associated with subpixel 60-2 and subpixel 60-3 is stored in horizontal subtraction circuit 62-H', and where the difference value associated with subpixel 60-2' and subpixel 60-3' is stored in horizontal subtraction circuit 62-H". The subtraction scheme can be repeated across the array for the remaining rows and all columns.

[0072] In the operation of block 106 (sometimes referred to as the third stage), the vertical odd switch vert_odd may be activated to store the difference from the third adjacent pair of subpixels in each column in the first portion of the vertical subtraction circuit 62-V. Fig.10 , where the difference values ​​associated with subpixels 60-1 and 60-1' are stored in vertical subtraction circuit 62-V', and where the difference values ​​associated with subpixels 60-2 and 60-2' are stored in vertical subtraction circuit 62-V'. This subtraction scheme may be repeated across the array for the remaining columns and all rows.

[0073] In the operation of block 108 (sometimes referred to as the fourth stage), the vertical even switch vert_even may be activated to store the difference from the fourth adjacent subpixel pair in each column in the second portion of the vertical subtraction circuit 62-V. Fig.11 , where the difference values ​​associated with subpixels 60-1′ and 60-1″ are stored in vertical subtraction circuit 62-V′, and where the difference values ​​associated with subpixels 60-2′ and 60-2″ are stored in vertical subtraction circuit 62-V″. This subtraction scheme may be repeated across the array for the remaining rows and all columns. After these four stages, the combination Fig.12 The described readout circuit can be used to scan out the stored difference values ​​in a sequential manner.

[0074] Figure 7 The embodiment is illustrative, wherein each pixel 34 includes one sub-pixel circuit 60 and two associated subtraction circuits 62-H and 62-V. Fig.15Another embodiment is shown where pixel 34 includes one subpixel circuit 60 and one subtraction circuit 62. Generally, the term "pixel" may refer to or be defined herein as a pixel circuit including one or more subpixel portions 60 and one or more subtraction circuit portions 62. Fig.15 The example of FIG. 4 shows a first row of pixels 34 having sub-pixel 60 - 1 and sub-pixel 60 - 2 and a second row of pixels 34 having sub-pixel 60 - 3 and sub-pixel 60 - 4 .

[0075] Fig.15 The sub-pixel 60-1 and the sub-pixel 60-2 in the first row may be coupled to the first horizontal (row) signal line 72-1, while Fig.15 The subpixel 60-3 and the subpixel 60-4 in the second row of the first pixel 60-3 and the subpixel 60-4 can be coupled to the second horizontal (row) signal line 72-2. The switch horz_odd and the switch horz_even can be set along the first horizontal signal line 72-1 to couple the subtraction circuits 62 in the first row together in an alternating manner. The switch horz_odd and the switch horz_even can also be set along the second horizontal signal line 72-2 to couple the subtraction circuits 62 in the second row together in an alternating manner.

[0076] Fig.15 The sub-pixel 60-1 and the sub-pixel 60-3 in the first column may be coupled to the first vertical (column) signal line 70-1, while Fig.15 The subpixel 60-2 and the subpixel 60-4 in the second column of the first vertical signal line 70-1 can be coupled to the second vertical (column) signal line 70-2. The switch vert_odd and the switch vert_even can be arranged along the first vertical signal line 70-1 to couple the subtraction circuits 62 in the first column together in an alternating manner. The switch vert_odd and the switch vert_even can also be arranged along the second vertical signal line 70-2 to couple the subtraction circuits 62 in the second column together in an alternating manner.

[0077] The subtraction circuit 62 associated with the subpixel 60-1 may have an input node selectively coupled to the horizontal signal line 72-1 via a first horizontal enable switch horz_en and selectively coupled to the vertical signal line 70-1 via a first vertical enable switch vert_en. The subtraction circuit 62 associated with the subpixel 60-2 may have an input node selectively coupled to the horizontal signal line 72-1 via a second horz_en (horizontal enable) switch and selectively coupled to the vertical signal line 70-2 via a second vert_en (vertical enable) switch. The subtraction circuit 62 associated with the subpixel 60-3 may have an input node selectively coupled to the horizontal signal line 72-2 via a third horz_en switch and selectively coupled to the vertical signal line 70-1 via a third vert_en switch. The subtraction circuit 62 associated with the subpixel 60-4 may have an input node selectively coupled to the horizontal signal line 72-2 via a fourth horz_en switch and selectively coupled to the vertical signal line 70-2 via a fourth vert_en switch.

[0078] shows a 2×2 array of four pixels 34 Fig.15 The array is illustrative and can be repeated in the row direction and the column direction. In general, the image sensor may include pixels 34 arranged in any number of rows and any number of columns (e.g., the image sensor array may include hundreds or thousands of rows and hundreds or thousands of columns). Each row of pixels can be coupled to a horizontal (row) signal line 72, wherein interspersed horz_even switches and horz_odd switches selectively couple adjacent subtraction circuits 62 together. Each column of pixels can be coupled to a vertical (column) signal line 70, wherein interspersed vert_even switches and vert_odd switches selectively couple adjacent subtraction circuits 62 together. The even switches and odd switches can be driven in a one-hot manner (e.g., only one of the switches horz_even, horz_odd, vert_even, and vert_odd can be activated at any point in time).

[0079] Fig.15A pixel array of the type shown in can be configured to perform a global difference and storage operation by executing a continuous subtraction network with moving boundaries via a four-stage operation. In the first stage, switch horz_odd and switch horz_en are turned on. In the second stage, the horz_even switch and the horz_en switch are turned on. In the third stage, the vert_odd switch and the vert_en switch are turned on. In the fourth stage, vert_even and vert_en are turned on. These four stages can be performed in any order until the subtraction (difference) values ​​from all horizontally adjacent sub-pixels and all vertically adjacent sub-pixels have been stored in the corresponding storage capacitors of each horizontal subtraction circuit 62 (e.g., see Figure 5 If necessary, the subtraction value of the vertical edge can be calculated before the horizontal edge.

[0080] Fig.16 is configured according to some embodiments with Fig.15 FIG. 1 is a diagram of an exemplary edge detection readout circuit operating with a pixel array 34 of the type shown in FIG. Fig.16 As shown in , the edge detection readout circuit may include a plurality of comparator circuits such as comparator 82, voltage buffers such as reference voltage buffer 80-1 and reference voltage buffer 80-2, and shift register circuits such as shift registers. Voltage buffer 80-1 may be configured to output (drive) a high reference voltage Vref_hi, and voltage buffer 80-2 may be configured to output (drive) a low reference voltage Vref_lo. Fig.14 The voltage levels of Vref_hi and Vref_lo are selected in the manner described.

[0081] Each comparator 82 may have a first input terminal configured to receive difference values ​​from a plurality of subtraction circuits 62 in a sequential manner, a second input terminal configured to receive a reference voltage Vref_hi from the voltage buffer 80-1, a third input terminal configured to receive a reference voltage Vref_lo from the voltage buffer 80-2, and an output terminal coupled to a corresponding register in the shift register 84. Configured in this manner, each comparator 82 may receive the stored difference values, the reference voltage Vref_hi, and the reference voltage Vref_lo from the subtraction circuit 62 in the corresponding column. The comparator 82 may be Fig.13 . Configured in this manner, a comparator output value equal to a logic "1" shifted from shift register 84 will indicate the presence of a detected edge, while a value equal to a logic "0" will indicate the absence of a detected edge. Detecting and reading edge information in this manner does not require any high resolution analog-to-digital converters and complex digital processing, and thus operations up to 1000 frames per second or more can be achieved.

[0082] Various embodiments of edge detection sensors are included. One aspect of the present disclosure provides a sensor including: an array of pixels arranged in rows and columns, wherein each pixel in the pixel array includes a subpixel circuit, a first subtraction circuit, and a second subtraction circuit; a first horizontal signal line, the first horizontal signal line coupled to a first row of pixels in the array; a first horizontal odd switch disposed along the first horizontal signal line, wherein the first horizontal odd switch is activated in a first phase, during which differences from adjacent subpixel pairs in the first row are stored in a first portion of the first subtraction circuit in the first row; and a first horizontal even switch disposed along the first horizontal signal line, wherein the first horizontal even switch is activated in a second phase, during which differences from adjacent subpixel pairs in the first row are stored in a second portion of the first subtraction circuit in the first row that is different from the first portion of the first subtraction circuit. The sensor may also include: a second horizontal signal line, the second horizontal signal line coupled to a second row of pixels in the array; a second horizontal odd switch arranged along the second horizontal signal line, wherein the second horizontal odd switch is activated in a first stage, during which the difference values ​​from adjacent sub-pixel pairs in the second row are stored in a first part of the first subtraction circuit in the second row; and a second horizontal even switch arranged along the second horizontal signal line, wherein the second horizontal even switch is activated in a second stage, during which the difference values ​​from adjacent sub-pixel pairs in the second row are stored in a second part of the first subtraction circuit in the second row that is different from the first part of the first subtraction circuit.

[0083] The sensor may also include a first vertical signal line coupled to a first column of pixels in the array; a first vertical odd switch disposed along the first vertical signal line, wherein the first vertical odd switch is activated in a third phase during which differences from adjacent sub-pixel pairs in the first column are stored in a first portion of a second subtraction circuit in the first column; and a first vertical even switch disposed along the first vertical signal line, wherein the first vertical even switch is activated in a fourth phase during which differences from adjacent sub-pixel pairs in the first column are stored in a second portion of a second subtraction circuit in the first column that is different from the first portion of the second subtraction circuit. The sensor may also include: a second vertical signal line, the second vertical signal line coupled to a second column of pixels in the array; a second vertical odd switch arranged along the second vertical signal line, wherein the second vertical odd switch is activated in a third stage, during which the difference values ​​from adjacent sub-pixel pairs in the second column are stored in a first part of a second subtraction circuit in the second column; and a second vertical even switch arranged along the second vertical signal line, wherein the second vertical even switch is activated in a fourth stage, during which the difference values ​​from adjacent sub-pixel pairs in the second column are stored in a second part of a second subtraction circuit in the second column that is different from the first part of the second subtraction circuit.

[0084] The sensor may also include: a first comparator circuit, the first comparator circuit having a first input terminal coupled to a first subtraction circuit in a first column of pixels in the array, a second input terminal configured to receive a first reference voltage, and a third input terminal configured to receive a second reference voltage that is less than the first reference voltage; a second comparator circuit, the second comparator circuit having a first input terminal coupled to a second subtraction circuit in a first column of pixels in the array, a second input terminal configured to receive the first reference voltage, and a third input terminal configured to receive the second reference voltage; a first shift register, the first shift register coupled to an output terminal of the first comparator circuit; a second shift register, the second shift register coupled to an output terminal of the second comparator circuit; and a logic OR gate, the logic OR gate having a first input terminal coupled to the first shift register and having a second input terminal coupled to the second shift register.

[0085] One aspect of the present disclosure provides a method, the method comprising: accumulating charge in a pixel array arranged in rows and columns, wherein each pixel in the pixel array comprises a subpixel circuit, a first subtraction circuit, and a second subtraction circuit; in a first stage, activating a horizontal odd switch and storing a difference value from an adjacent subpixel pair in a first row of pixels in a first portion of the first subtraction circuit in the first row; and

[0086] Outputting an edge image based on the stored difference values. The method may also include: during a second stage, activating a horizontal even switch and storing difference values ​​from adjacent sub-pixel pairs in a first row of pixels in a second portion of a first subtraction circuit in the first row; during a third stage, activating a vertical odd switch and storing difference values ​​from adjacent sub-pixel pairs in a first column of pixels in a first portion of a second subtraction circuit in the first column; and during a fourth stage, activating a vertical even switch and storing difference values ​​from adjacent sub-pixel pairs in a first column of pixels in a second portion of a second subtraction circuit in the first column.

[0087] One aspect of the present disclosure provides a sensor, the sensor including a pixel having a subpixel circuit and a subtraction circuit, wherein: the subpixel circuit in each pixel in the array includes a photodiode, a charge transfer transistor coupled between the photodiode and a floating diffusion node, a reset transistor coupled to the floating diffusion node, a source follower transistor having a gate terminal coupled to the floating diffusion node, and a row select transistor coupled in series with the source follower transistor; the subpixel is coupled to the subtraction circuit via a horizontal odd switch; the subpixel is coupled to the subpixel circuit of an adjacent pixel in the same row via a horizontal even switch; the subpixel is coupled to the subtraction circuit via a vertical even switch; and the subpixel is coupled to the subpixel circuit of an adjacent pixel in the same column via a vertical odd switch. The sensor may also include a horizontal enable switch coupled between the horizontal odd switch and the subtraction circuit and a vertical enable switch coupled between the vertical even switch and the subtraction circuit. During the first phase, the horizontal odd switch and the horizontal enable switch may be activated. During the second phase, the horizontal even switch and the horizontal enable switch may be activated. During the third phase, the vertical odd switch and the vertical enable switch may be activated. During the fourth phase, the vertical even switch and the vertical enable switch may be activated.

[0088] The above contents are merely exemplary, and various modifications may be made to the described embodiments. The above embodiments may be implemented individually or in any combination.

Claims

1. A sensor, comprising: a pixel array arranged in rows and columns, wherein each pixel in the pixel array comprises a sub-pixel circuit, a first subtraction circuit, and a second subtraction circuit; a first horizontal signal line coupled to a first row of pixels in the array; a first horizontal odd switch along the first horizontal signal line, wherein the first horizontal odd switch is configured to be activated in a first phase during which a difference value from a first adjacent pair of subpixels in the first row is stored in a first portion of the first subtraction circuit in the first row; as well as a first horizontal even switch along the first horizontal signal line, wherein the first horizontal even switch is configured to be activated in a second phase, during which a difference from a second adjacent subpixel pair in the first row is stored in a second portion of the first subtraction circuit in the first row that is different from the first portion of the first subtraction circuit.

2. The sensor of claim 1 , wherein the sub-pixel circuitry in each pixel in the array comprises: Photodiode; a charge transfer transistor coupled between the photodiode and a floating diffusion node; a reset transistor coupled to the floating diffusion node; a source follower transistor having a gate terminal coupled to the floating diffusion node; as well as A row select transistor is coupled in series with the source follower transistor.

3. The sensor of claim 1 , wherein the first subtraction circuit comprises: a first pre-charge transistor, the first pre-charge transistor coupled to an input node of the first subtraction circuit; a sampling capacitor having a first terminal coupled to the input node of the first subtraction circuit and having a second terminal; a reset transistor coupled to the second terminal of the sampling capacitor; a source follower transistor having a gate terminal coupled to the second terminal of the sampling capacitor; a row select transistor coupled in series with the source follower transistor; a second pre-charge transistor, the second pre-charge transistor being coupled in series with the row select transistor; a storage capacitor coupled to a given node between the row selection transistor and the second precharge transistor; as well as A capacitor selection transistor is coupled between the given node and the storage capacitor.

4. The sensor according to claim 1, further comprising: a second horizontal signal line coupled to a second row of pixels in the array; a second horizontal odd switch along the second horizontal signal line, wherein the second horizontal odd switch is configured to be activated in the first phase during which a difference value from a third adjacent pair of subpixels in the second row is stored in a first portion of the first subtraction circuit in the second row; as well as a second horizontal even switch along the second horizontal signal line, wherein the second horizontal even switch is configured to be activated in the second phase, during which the difference from the fourth adjacent subpixel pair in the second row is stored in a second part of the first subtraction circuit in the second row that is different from the first part of the first subtraction circuit.

5. The sensor according to claim 1, further comprising: a first vertical signal line coupled to a first column of pixels in the array; a first vertical odd switch along the first vertical signal line, wherein the first vertical odd switch is configured to be activated in a third phase during which a difference value from a third adjacent pair of subpixels in the first column is stored in a first portion of the second subtraction circuit in the first column; as well as a first vertical even switch along the first vertical signal line, wherein the first vertical even switch is configured to be activated in a fourth phase, during which a difference value from a fourth adjacent subpixel pair in the first column is stored in a second portion of the second subtraction circuit in the first column that is different from the first portion of the second subtraction circuit.

6. The sensor according to claim 5, further comprising: a second vertical signal line coupled to a second column of pixels in the array; a second vertical odd switch along the second vertical signal line, wherein the second vertical odd switch is configured to be activated in the third phase during which a difference value from a fifth adjacent pair of subpixels in the second column is stored in the first portion of the second subtraction circuit in the second column; as well as a second vertical even switch along the second vertical signal line, wherein the second vertical even switch is configured to be activated in the fourth phase, during which the difference from the sixth adjacent subpixel pair in the second column is stored in a second portion of the second subtraction circuit in the second column that is different from the first portion of the second subtraction circuit.

7. The sensor according to claim 1, further comprising: A first comparator circuit having a first input coupled to the first subtraction circuit in a first column of pixels in the array, a second input configured to receive a first reference voltage, and a third input configured to receive a second reference voltage that is less than the first reference voltage.

8. The sensor according to claim 7, further comprising: A second comparator circuit having a first input coupled to the second subtraction circuit in the first column of pixels in the array, a second input configured to receive the first reference voltage, and a third input configured to receive the second reference voltage.

9. The sensor according to claim 8, further comprising: a first shift register, the first shift register being coupled to an output terminal of the first comparator circuit; as well as A second shift register is coupled to an output terminal of the second comparator circuit.

10. The sensor according to claim 9, further comprising: A logic OR gate having a first input terminal coupled to the first shift register and having a second input terminal coupled to the second shift register.

11. The sensor of claim 7, wherein the first comparator circuit comprises: a first comparator subcircuit having a first input configured to receive the first reference voltage and having a second input coupled to the first subtraction circuit in the first column of pixels in the array; a second comparator subcircuit having a first input configured to receive the second reference voltage and having a second input coupled to the second input of the first comparator subcircuit; as well as A logic NAND gate having a first input coupled to the output of the first comparator sub-circuit and having a second input coupled to the output of the second comparator sub-circuit.

12. A method of operating a sensor, the method comprising: accumulating charge in an array of pixels arranged in rows and columns, wherein each pixel in the array of pixels includes a subpixel circuit, a first subtraction circuit, and a second subtraction circuit; In a first stage, a horizontal odd switch is activated and a difference value from a first adjacent pair of subpixels in a first row of pixels is stored in a first portion of the first subtraction circuit in the first row; as well as An edge image is output based on the stored difference values.

13. The method according to claim 12, further comprising: In a second phase, the horizontal even switch is activated and a difference value from a second adjacent pair of sub-pixels in the first row of pixels is stored in a second portion of the first subtraction circuit in the first row.

14. The method according to claim 13, further comprising: In a third phase, the vertical odd switches are activated and the difference values ​​from a third adjacent pair of sub-pixels in a first column of pixels are stored in a first portion of the second subtraction circuit in the first column.

15. The method according to claim 14, further comprising: In a fourth phase, the vertical even switch is activated and a difference value from a fourth adjacent pair of sub-pixels in the first column of pixels is stored in a second portion of the second subtraction circuit in the first column.

16. The method according to claim 15, further comprising: receiving, with a first comparator, the stored difference value from the first subtraction circuit in the first column and receiving a first reference voltage and a second reference voltage; receiving, with a second comparator, the stored difference value from the second subtraction circuit in the first column and receiving the first reference voltage and the second reference voltage; receiving a comparator output value from the first comparator using a first shift register; as well as The comparator output value is received from the second comparator using a second shift register.

17. A sensor, comprising: A pixel comprising a sub-pixel circuit and a subtraction circuit, wherein The subpixel circuit includes a photodiode, a charge transfer transistor coupled between the photodiode and a floating diffusion node, a reset transistor coupled to the floating diffusion node, a source follower transistor having a gate terminal coupled to the floating diffusion node, and a row select transistor coupled in series with the source follower transistor, The sub-pixel is coupled to the subtraction circuit via a horizontal odd switch, The sub-pixel is coupled to the sub-pixel circuit of an adjacent pixel in the same row via a horizontal even switch, The sub-pixel is coupled to the subtraction circuit via a vertical even switch, and The sub-pixel is coupled to the sub-pixel circuit of an adjacent pixel in the same column via a vertical odd switch.

18. The sensor of claim 17, wherein the subtraction circuit comprises: a first pre-charge transistor coupled to an input node of the subtraction circuit; a sampling capacitor having a first terminal coupled to the input node of the subtraction circuit and having a second terminal; an additional reset transistor coupled to the second terminal of the sampling capacitor; an additional source follower transistor having a gate terminal coupled to the second terminal of the sampling capacitor; an additional row select transistor coupled in series with the additional source follower transistor; a second pre-charge transistor coupled in series with the additional row select transistor; a storage capacitor coupled to a given node between the additional row selection transistor and the second pre-charge transistor; as well as A capacitor selection transistor is coupled between the given node and the storage capacitor.

19. The sensor according to claim 17, further comprising: a horizontal enable switch coupled between the horizontal odd switch and the subtraction circuit; as well as a vertical enable switch coupled between the vertical even switch and the subtraction circuit, wherein In the first stage, the horizontal odd switches and the horizontal enable switches are configured to be activated, In the second stage, the horizontal even switch and the horizontal enable switch are configured to be activated, In the third phase, the vertical odd switches and the vertical enable switches are configured to be activated, and In a fourth phase, the vertical even switches and the vertical enable switches are configured to be activated.

20. The sensor of claim 17, further comprising: a comparator having a first input terminal coupled to the subtraction circuit, a second input terminal configured to receive a first reference voltage, and a third input terminal configured to receive a second reference voltage different from the first reference voltage; as well as A shift register has an input terminal coupled to the comparator.

Citation Information

Cited By

  • Image sensor and pixel control circuit, reading circuit and reading method thereof

    CN121013008A