Pixel readout circuit
The ROIC with a global timing circuit and shared connections in pixel readout circuits addresses the challenge of simultaneous laser pulse detection and imaging in focal plane arrays, achieving fast and accurate event detection with pixel-level resolution.
Patent Information
- Application Number
- JP2024084996
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-24
- Filing Date
- 2024-05-24
- Publication Date
- 2024-12-05
AI Technical Summary
Existing pixel readout circuits struggle to simultaneously detect and time-stamp laser pulses with pixel-level resolution in imaging systems, particularly in focal plane arrays, leading to delayed and inaccurate detection of fast events.
A pixel readout integrated circuit (ROIC) with a global timing circuit and shared electrical connections among pixel circuits, detecting electrical fluctuations to identify laser pulse arrivals and generate timestamps, allowing for simultaneous pixel-level event detection and imaging.
Enables fast and accurate detection of laser pulses with pixel-level resolution, providing simultaneous imaging and event detection, enhancing the speed and precision of laser pulse identification in focal plane arrays.
Smart Images

Figure 2024169421000001 
Figure 2024169421000002 
Figure 2024169421000003
Abstract
Description
[Technical field]
[0001] The present disclosure, in some embodiments thereof, relates to pixel readout circuits, and more particularly, but not exclusively, to pixel readout integrated circuits for use with focal plane arrays (FPAs) of photodetector pixels. [Background technology]
[0002] US Patent No. 9,215,386 discloses that "The present invention provides a pixel readout integrated circuit (ROIC) that is integrated with any type of active matrix photodetector (photodiode) to create an advanced multi-function infrared detector with on-chip processing. The present invention also provides a new type of detector that includes a readout integrated circuit (ROTC) with advanced on-chip signal processing... More specifically, the readout circuit is capable of simultaneously or nearly simultaneously implementing two different modes: pixel-by-pixel imaging mode and event detection mode, which are implemented by processing the same frame of data. In single pixel event detection mode, the readout circuit identifies a particular event as a positive change in photocurrent, which may indicate the presence of a laser pulse or a weapon fire pulse, which is any electromagnetic radiation pulse that is converted into an electrical current by the detector element. Due to the fact that such high speed event detection is performed simultaneously with acquiring an image of the same frame, not only is the high speed event detected, but its location within the frame being imaged from the region of interest can also be determined with pixel size resolution."
[0003] Additional background art includes U.S. Pat. No. 9,215,386 and U.S. Patent Application Publication No. 2021 / 0360184.
[0004] Acknowledgement of the above references herein, each of which is incorporated herein by reference in its entirety, should not be inferred as meaning that they are in any way relevant to the patentability of the presently disclosed subject matter. Summary of the Invention
[0005] Below is a non-exhaustive list of some exemplary embodiments of the present disclosure. The present disclosure also includes embodiments including less than all of the features in an example, and embodiments that use features from more than one example, even if not listed below.
[0006] Example 1. An imaging system, a photodetector pixel array configured to provide a plurality of light measurement signals of a field of view (FOV); a pixel circuitry array (PCA) comprising a plurality of pixel circuits, each pixel circuit associated with a pixel of the photodetector pixel array and configured to receive one of the plurality of light measurement signals; at least one electrical connection to and shared by at least two pixel circuits of the plurality of pixel circuits, the at least two pixel circuits each associated with at least two detector pixels of the detector pixel array; and and a detection circuit configured to detect electrical variations associated with receipt of a pulse of laser light at the photodetector pixel array.
[0007] Example 2. The imaging system of example 1, comprising a global timing circuit configured to time stamp said electrical variations.
[0008] Example 3. The imaging system of example 1 or 2, wherein the connection is a power connection to the at least two pixel circuits.
[0009] Example 4. The imaging system of example 1 or 2, wherein the connection is a reference voltage supplied to the at least two pixel circuits.
[0010] Example 5. The imaging system of any one of Examples 1-4, wherein the detection circuitry is configured to associate the electrical variation with one or more of the plurality of pixel circuits.
[0011] Example 6. The imaging system of any one of Examples 2-5, wherein the global timing circuit is configured to associate the time stamp with one or more of the plurality of pixel circuits.
[0012] Example 7. The imaging system according to any one of Examples 1 to 6, wherein two or more of the plurality of pixel circuits each have one detection channel of the plurality of detection channels.
[0013] Example 8. The imaging system of example 7, wherein the multiple detection channels provide detection data.
[0014] Example 9. An imaging system as described in Example 8, wherein the multiple detection channels are configured to pass the detection data to one or more frame makers for construction of a detection frame, and each detection channel is associated with a pixel of the detection frame.
[0015] Example 10. The imaging system of any one of Examples 7-9, wherein the timestamp is associated with one or more pixels of the detection frame.
[0016] Example 11. The imaging system according to any one of Examples 7 to 10, wherein the connection is to two or more detection channels of the plurality of detection channels.
[0017] Example 12. The imaging system of any one of Examples 7-10, wherein at least a portion of the plurality of pixel circuits each have an imaging channel configured to provide image data.
[0018] Example 13. An imaging system as described in Example 12, wherein the detection data and the image data are provided in association with each other.
[0019] Example 14. The imaging system of Example 13, wherein each pixel of the detected data is associated with one or more pixels of the image data.
[0020] Example 15. An imaging system as described in any one of Examples 2 to 14, configured to communicate with a laser source configured to direct a pulse of laser light towards the FOV at a known time.
[0021] Example 16. An imaging system as described in Example 15, wherein the reception at the photodetector pixel array is of a portion of a pulse of laser light emitted by the laser source and reflected by an object within the FOV.
[0022] Example 17. An imaging system as described in Example 15 or 16, comprising processing and memory circuitry configured to use the timestamp and the known time to determine the range between one or more components of the system and the object.
[0023] Example 18. The detection circuit is configured to detect a plurality of surges in power consumption; 18. The imaging system according to any one of Examples 2 to 17, wherein the global timing circuit is configured to provide a plurality of time stamps, one for each of the plurality of surges.
[0024] Example 19. The imaging system according to any one of Examples 1 to 18, wherein the PCA includes a plurality of pixel circuits, each of the plurality of pixel circuits having an imaging channel.
[0025] Example 20. A processing and memory circuitry (PMC) is provided, 20. The imaging system of example 19, wherein each imaging channel is configured to pass image data to an image processing unit for construction of an image.
[0026] Example 21. An imaging system as described in Example 18 or 19, comprising a processing and memory circuit (PMC) configured to identify a laser source using the multiple timestamps.
[0027] Example 22. The imaging system of any one of Examples 2-21, wherein the global timing circuit comprises a counter, and wherein a counter value upon detection of the variation provides the time stamp.
[0028] Example 23. The imaging system of Example 22, wherein the counter is reset upon detection of the variation.
[0029] Example 24. The global timing circuit includes a counter that is started upon detection of the variation; 22. The imaging system according to any one of Examples 2 to 21, wherein the counter value upon detection of a subsequent second variation provides a time measure between detected variations.
[0030] Example 25. A ROIC comprising: a pixel circuit array (PCA) comprising a plurality of pixel circuits, each pixel circuit configured to receive a light measurement signal from a detector of the photodetector pixel array; a detection circuit configured to detect an electrical variation associated with receipt of a pulse of laser light at said photodetector pixel array; and a global timing circuit configured to timestamp the electrical variations in power consumption.
[0031] Example 26. A liquid crystal display device comprising: at least one driver configured to provide power to the plurality of pixel circuits; 26. The ROIC of Example 25, wherein the detection circuitry is configured to detect the electrical variation in power consumption in one or more connections between the driver and the plurality of pixel circuits.
[0032] Example 27. A method of imaging comprising: acquiring a plurality of measurement signals of a field of view (FOV) using an array of photodetectors, each detector producing one of the plurality of measurement signals; detecting and time stamping electrical variations associated with receipt of a pulse of laser light at the array of photodetectors.
[0033] Example 28. An imaging system, comprising: a photodetector pixel array configured to provide a plurality of light measurement signals of a field of view (FOV); a pixel circuit array (PCA) comprising a plurality of pixel circuits, each pixel circuit associated with a pixel of the photodetector pixel array and configured to receive one of the plurality of light measurement signals; at least one electrical connection to and shared by at least two pixel circuits of the plurality of pixel circuits, the at least two pixel circuits each associated with at least two detector pixels of the detector pixel array; and a detection circuit configured to detect an electrical variation associated with receipt at said photodetector pixel array of a pulse of laser light; a global timing circuit configured to provide a timestamp of the electrical variation, the timestamp being associated with one or more of the plurality of pixel circuits; a plurality of detection channels, each associated with one pixel circuit of the plurality of pixel circuits and configured to provide detection data, each pixel associated with one pixel circuit of the plurality of pixel circuits; and a plurality of imaging channels, each associated with one pixel circuit of the plurality of pixel circuits and configured to provide image data, each pixel associated with one pixel circuit of the plurality of pixel circuits.
[0034] Unless otherwise defined, all technical and / or scientific terms used in this document have the meaning commonly understood by those skilled in the art to which this disclosure belongs. Methods and / or materials similar or equivalent to those described herein can be used in the practice and / or testing of embodiments of the present disclosure, and exemplary methods and / or materials are described below. With regard to the exemplary embodiments described below, the materials, methods, and examples are illustrative and are not necessarily intended to be limiting. [Brief description of the drawings]
[0035] In order to better understand the subject matter disclosed herein, and to illustrate how it may be carried out in practice, embodiments will now be described, by way of non-limiting example only, with reference to the accompanying drawings, in which: [Figure 1] 1 is a simplified schematic diagram of a portion of an imaging system according to some embodiments of the present disclosure. [Figure 2A] FIG. 2 is a simplified schematic diagram of a portion of a detector array and a ROIC in accordance with some embodiments of the present disclosure. [Figure 2B] FIG. 2 is a simplified schematic diagram of a ROIC, in accordance with some embodiments of the present disclosure. [Diagram 3] 1 is a method according to some embodiments of the present disclosure. [Figure 4] FIG. 1 is a simplified schematic block diagram of an imaging system in accordance with some embodiments of the present disclosure. [Diagram 5] 1 is a method of imaging and detection according to some embodiments of the present disclosure. [Figure 6] 1 includes simplified schematic illustrations of imaging according to some embodiments of the present disclosure. [Figure 7] 1 is a simplified schematic diagram of a portion of a system including multiple pixel circuits and detection circuitry in accordance with some embodiments of the present disclosure. [Figure 8] 1 is a detection method according to some embodiments of the present disclosure. [Figure 9A]FIG. 2 is a simplified schematic diagram of a detection circuit according to some embodiments of the present disclosure. [Figure 9B] FIG. 2 is a simplified schematic diagram of a detection circuit according to some embodiments of the present disclosure. [Figure 9C] 1 is a calibration method according to some embodiments of the present disclosure. [Figure 10] FIG. 2 is a simplified schematic block diagram of image and post-processing circuitry in accordance with some embodiments of the present disclosure. [Figure 11] 1 is a method according to some embodiments of the present disclosure.
[0036] In some embodiments, but not by way of limitation, in different figures, like numerals are used to refer to like elements, for example, element 112 in FIG. 1 which corresponds to element 212 in FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0037] The present disclosure, in some embodiments thereof, relates to pixel readout circuits, and more particularly, but not exclusively, to pixel readout integrated circuits for use with focal plane arrays (FPAs) of photodetector pixels.
[0038] overview A broad aspect of some embodiments of the present disclosure relates to using a focal plane array (FPA) having multiple pixel detectors and a readout integrated circuit (ROIC) circuit coupled to the FPA to detect timing of receipt of a laser light pulse at a global level defined globally for two or more pixels, e.g., in addition to using the FPA for imaging and / or to provide array-based detection of laser pulses.
[0039] One aspect of some embodiments of the present disclosure relates to monitoring one or more connections to the pixel circuitry of the ROIC, surges in voltage levels, and / or current passing through the connections, which are used to identify the timing of the arrival of laser light at the pixels of the FPA.
[0040] Without wishing to be bound by theory, it is theorized that upon receipt of laser light to the pixel detector, the circuitry associated with imaging and / or detection experiences a power surge that changes, for example, the voltage levels of connections and / or the current through connections, where in some embodiments a pixel event is detectable as a brief high intensity change.
[0041] In some embodiments, for example, other circuits that are not directly connected experience similar surges that are associated with, for example, parasitic effects that it is theorized are associated with, where in some embodiments, a pixel event is identified by monitoring one or more shared connections to multiple individual pixel circuits.
[0042] Here, in some embodiments, the connections include voltages and / or currents in one or more of power supplies, biases, references, thresholds, control signals, and ground leakage.
[0043] In an exemplary embodiment, the surge is detected at a connection to a latch of the detection circuit. If the latch changes state upon detection of light by the detection pixel, the change in state causes an associated fluctuation in the power supply and / or bias to the latch. In some embodiments, the connection is shared by more than one pixel circuit, potentially meaning that multiple pixels can be monitored at once. Potentially, identifying a pixel event from a detected surge at a connection provides more accurate (and / or faster) timing information regarding the arrival of light at the detector array, for example because the measurement is not delayed by the time required to read out a value from the detection circuit. For example, detecting a surge at a shared connection is more rapid than one that requires reading out measurements from individual pixels, e.g., including a row-by-row sequential readout.
[0044] In some embodiments, at least two different types of signals from measurement pixels of a focal plane array (FPA) of photodetector pixels are identified (e.g., including features as described in U.S. Pat. No. 9,215,386, the entirety of which is incorporated herein by reference).
[0045] Here, for example, individual pixel measurement signals are processed to provide both imaging data relating to a first signal in the sensed light (e.g., by integrating the signal) and detector data relating to receipt of a second signal in the sensed light (e.g., by responding to fast variations in the intensity of the signal), where in some embodiments the first signal is associated with measurement of visible and / or short wave infrared SWIR light, where in some embodiments the second signal of light is associated with measurement of one or more pulses of a laser.
[0046] In some embodiments, where a detected surge is associated with more than one pixel, for example, in some embodiments a global power consumption signal (e.g., global to an area of the FPA that includes more than one pixel, e.g., global to the entire detector array) is used to provide the timing of arrival of the second signal, for example where, in some embodiments, identifying the characteristic surge includes storing the timing of the surge (e.g., generating a timestamp).
[0047] One aspect of some embodiments relates to emitting a second signal at a known time toward a field of view (FOV) of a detector array, and the detection data includes detection of reflections of the emitted second signal by one or more objects within the FOV. In some embodiments, the identified timing of arrival of the second signal at the detector is used to determine a distance to the object (also referred to herein as a "range"), for example, a distance between the object and the detector array.
[0048] In some embodiments, in addition to or instead of the timing of arrival, the location and / or intensity within the detector array and / or the number of pixels sensing the arrival of the second signal are used to enhance the image data.
[0049] For example, in some embodiments, the determined range is provided (e.g., for display) along with the imaging and / or detection data, where, for example, a display provides an indication of the distance to the object along with, for example, the location of the object within the field of view of the detection and / or image data.
[0050] The arrival of a pulse of the second signal at a pixel of the detector array is referred to herein as a "pixel event," and / or the pixel at which the light pulse arrives is referred to as an "active pixel."
[0051] One aspect of some embodiments relates to measuring the time between adjacent pixel events. For example, in some embodiments, a light source modulation signal is extracted, where in some embodiments, a second signal has a characteristic signature that is identifiable from the characteristics of the pulses of the second signal that reach the detector array. For example, in some embodiments, a laser source has a characteristic time-modulated pulse, the modulation of which in some embodiments is determined from the timing of pixel events detected at the detector (e.g., to identify the laser source).
[0052] Before describing at least one embodiment of the invention in detail, it is to be understood that the invention is not necessarily limited in its application to the details of construction and arrangement of the components and / or methods set forth in the following description and / or illustrated in the drawings and / or examples. The invention is capable of other embodiments or of being practiced and carried out in various ways.
[0053] FIG. 1 is a simplified schematic diagram of a portion of an imaging system 100 in accordance with some embodiments of the present disclosure.
[0054] In some embodiments, system 100 includes an array of photodetectors (also referred to herein as a "focal plane array (FPA)" and a "photodetector array"), also referred to herein as "photodetectors," "photosensors," "detectors," and "pixels" (not shown).
[0055] In some embodiments, the system 100 includes a readout integrated circuit (ROIC) 111 that includes an array 151 of pixel circuits 112 .
[0056] Here, in some embodiments, each detector in the photodetector array is associated with a pixel circuit 112 in a pixel circuit array (PCA) 151. In some embodiments, each photodetector is associated with a single corresponding pixel circuit 112 in the PCA 151, for example, as shown in and / or described with respect to FIGS.
[0057] In some embodiments, the ROIC 111 includes an infrared imaging ROIC that is used to read out a particular type of detector hybridized to the FPA and generate an image. In some embodiments, the ROIC 111 performs one or more of the following: accumulates the photocurrent from each pixel, drives a photocurrent signal out of the pixel matrix, converts the photocurrent signal to digital, and drives a signal through a link to provide a signal, for example for readout and / or display.
[0058] In some embodiments, the ROIC 111 stores the signal charge in each pixel and then routes the signal to an output tap for readout.
[0059] In some embodiments, the ROIC 111 has a high speed analog output for communicating pixel data external to the integrated circuit, in some embodiments, analog-to-digital conversion (ADC) is implemented to provide a digital output, optionally the ADC is provided on-chip within the ROIC 111.
[0060] For ease of illustration, PCA 151 includes four pixel circuits 112 in FIG. 1, however, in some exemplary embodiments PCA 151 includes between 100k and 20M pixel circuits, or between 300k and 10M pixel circuits, or between 300k and 5M pixel circuits, or a lower, higher, or intermediate number or range.
[0061] In some embodiments, the detector array and PCA 151 generate a measurement signal 150 for each of the detectors.
[0062] In some embodiments, the system 100 includes a detection circuit 122 coupled to one or more elements 119, which in some embodiments includes a power connection to the PCA 151. Here, the element 119 in some embodiments includes, for example, a driver that provides a control signal, such as a reference voltage. The detection circuit 122 is configured to detect a variation (e.g., the timing of the variation) in an electrical connection of the PCA 151 to the pixel circuit 112 associated with a pixel event.
[0063] Although FIG. 1 illustrates a single detection circuit 122 for all of the pixel circuits 112, in some embodiments, the system 100 includes multiple detection circuits 122, with each detection circuit configured to detect pixel events associated with multiple pixel circuits.
[0064] In some embodiments, the system 100 includes a global timing circuit 121 that, upon receiving a signal indicative of a pixel event from the detection circuit 122, generates and optionally stores a timestamp signal 134 of the pixel event.
[0065] FIG. 2A is a simplified schematic diagram of a portion of a detector array 210 and a ROIC 211, according to some embodiments of the present disclosure.
[0066] FIG. 2B is a simplified schematic diagram of ROIC 211 according to some embodiments of the present disclosure.
[0067] FIG. 2A illustrates a focal plane array 210 comprising an array of photodetectors 210-1, eg, solid state detectors, also referred to interchangeably herein as "detectors," "pixels," and "sensors."
[0068] 2A with the detector array 210 removed to reveal an array of elements 252 that each connect a detector 210-1 to an associated pixel circuit 212, where in an exemplary embodiment, one or more of the connectors 252 include indium bumps.
[0069] In some embodiments, the ROIC 211 includes multiple pixel circuits 212, and in some embodiments, a single pixel circuit 212 is associated with each detector 210-1 of the detector array 210 to form an FPA hybrid ROIC.
[0070] In some embodiments, one or more of the pixel circuits 212 performs one or more of integrating, amplifying, and multiplexing charge on an associated detector 210-1, e.g., charge associated with photons impinging on the detector 210-1.
[0071] FIG. 3 is a method according to some embodiments of the present disclosure.
[0072] At 300, in some embodiments, data regarding a light source is received.
[0073] For example, the timing of a laser light pulse, such as the emission of laser light emitted by light source 423 of FIG.
[0074] For example, information about the light source received at the detector (e.g., a signature of the light source), where in some embodiments the signature includes data about the modulation of the pulses of a pulsed laser source detected by the detector, e.g., time modulation data.
[0075] At 302, in some embodiments, power consumption is monitored. For example, monitoring is performed on one or more power connections to one or more portions of a system (e.g., system 100 of FIG. 1, e.g., system 400 of FIG. 4, e.g., system 700 of FIG. 7).
[0076] Wherein, in some embodiments, monitoring includes monitoring one or more of the connections for electrical variations, such as variations in voltage levels and / or current passing through the connections, where in some embodiments the connections are compared to a threshold to identify, where example comparison circuits are illustrated in and / or described with respect to Figures 9A and / or 9B.
[0077] At 304, in some embodiments, electrical variations associated with pixel events are detected.
[0078] In some embodiments, the detecting includes identifying that a power supply voltage exceeds a threshold. Alternatively or additionally, in some embodiments, the detecting includes identifying that a power supply current exceeds a threshold.
[0079] At 306, in some embodiments, upon detecting a pixel event in step 302, a timestamp and / or time measure is generated.
[0080] In some embodiments, the detection is during a time frame, and in some embodiments, the time frame is initiated by a trigger signal.
[0081] In some embodiments, the time frame is ended by a trigger signal. Alternatively or additionally, in some embodiments, the end of the time frame occurs when the measured time exceeds a predetermined maximum value, which in some embodiments corresponds to the maximum allowable range of the rangefinder.
[0082] In some embodiments, when a pixel event is detected in a frame, a counter is used to provide a timestamp and is then optionally terminated (also referred to herein as "reset").
[0083] In some embodiments, multiple timestamps are generated, e.g., each timestamp is associated with a different laser light detection. For example, in some embodiments, when a pixel event is detected within a frame, the value in the counter element is used to provide a timestamp, e.g., multiple times within the frame, where in some embodiments the counter is reset after the duration of the frame.
[0084] For example, during calibration, in some embodiments, multiple timestamps are generated, for example, as illustrated in FIG. 9C.
[0085] In some embodiments, a time measure is generated, for example where the time measure indicates the time between two events. In some embodiments, the time measure is the duration between pixel events, where, for example, in some embodiments a counter is started upon detection of a pixel event, where, in some embodiments, the counter is then stopped (and optionally paused) upon detection of a subsequent pixel event, and the value of the counter provides, for example, a time measure of the time elapsed between pixel events.
[0086] In some embodiments, both the timestamps of pixel events and the time measure between pixel events are provided as inputs, for example to a display.
[0087] In some embodiments, the detecting includes detecting the light intensity of the pixel event, where in some embodiments the signal including the timestamp and intensity is passed to a processing and memory circuit (PMC), where the PMC includes, for example, one or more controllers, where in some embodiments the PMC processes the signal and / or outputs and / or provides data, for example, for display to a user. An exemplary portion of a PMC is illustrated, for example, in FIG. 10.
[0088] In some embodiments, detecting the intensity of the pixel event includes measuring an analog intensity signal.
[0089] At 308, in some embodiments, the timestamp is used, for example, to determine range to an object, for example, to extract a light source modulation signal (e.g., in a PRF technique), or for example, when using the timestamp to wake up a system function.
[0090] In some embodiments, the timestamp is used in conjunction with the timing information received in step 300 to determine the range to an object reflecting the laser pulse, for example the range between the object and the laser emitting the pulse.
[0091] In some embodiments, the timestamp, along with the location (e.g., area, e.g., area having a size greater than one pixel) of the pixel event for which the timestamp is produced, is used to provide an indication of the location of an object within the FOV of the detector array, where the indication is more rapid than, for example, using detection frames and / or imaging to identify the location of the object.
[0092] Optionally, in some embodiments, the intensity of the received light is used to determine and / or verify range, where, for example, a higher intensity is understood to be associated with a smaller range, e.g., a greater number of pixels experiencing a pixel event.
[0093] In some embodiments, the timestamp is used to extract the light source modulation signal, for example, where in some embodiments the timestamp is used in pulse repetition frequency (PRF) techniques and is employed using the timestamp.
[0094] For example, here the timestamp is used to identify the light source producing the detected light, e.g., here the time data of the detected pulse is compared to known signature information of multiple light sources to identify which light source is being detected.
[0095] Optionally, in some embodiments, the intensity of the received light is used to identify and / or verify the light source (e.g., in addition to timing information), where the known signature information in some embodiments includes intensity information.
[0096] Optionally, the timestamp signal is used as a wake-on-demand mechanism to recognize when the laser is present, for example, before using the timestamp to extract the optical modulation signal.
[0097] A potential advantage of using pixel event detection for monitoring is the low power consumption of the monitor.
[0098] A potential advantage of using pixel event detection is increased speed, for example, compared to evaluating the entire detection frame to find the timing of arrival.
[0099] FIG. 4 is a simplified schematic block diagram of an imaging system 400 in accordance with some embodiments of the present disclosure.
[0100] In some embodiments, system 400 includes a detector array 410 (e.g., including one or more features of detector array 210 of FIG. 2A) and a PCA 451 (e.g., including an array of pixel circuits including one or more features of PCA 151 of FIG. 1).
[0101] In some embodiments, system 400 includes one or more light sources 423, which in some embodiments include a laser configured to emit pulses of laser light toward a field of view (FOV) of system 400. In some embodiments, light source 423 produces light with a pulse duration of 1 ns to 1 μs, or 1 ns to 500 ns, or a shorter or longer or intermediate pulse duration or range. In some embodiments, light source 423 produces laser light pulses with an intensity between 1 ke to 100 ke, or a lower or higher or intermediate range intensity.
[0102] In some embodiments, the detector array 410 produces a measurement signal 454 for each detector of the detector array 410. In some embodiments, the PCA 451 receives the measurements 454, e.g., one or more measurement signals are received from the detectors to each pixel circuit of the PCA 451.
[0103] In some embodiments, the PCA 451 passes multiple image signals 450 to a processing and memory circuit (PCM) 441, which may include, for example, a controller, where in some embodiments each image signal corresponds to a single pixel circuit and / or detector pixel.
[0104] In some embodiments, the system 400 includes one or more power sources 419. For ease of illustration, only the power source 419 connections to the ROIC 411 are shown, although in some embodiments the power source 419 supplies other elements of the system 400 (e.g., one or more laser sources 423 and a user interface 443).
[0105] In some embodiments, the system 400 includes a detection circuit 422 that measures and / or detects electrical variations in a connection 470 to the pixel circuit 411, the electrical variations being associated with a pixel event. For example, here, the ROIC 411 includes one or more elements 419-1, 419-2 connected to the pixel circuit of the PCA 451. Here, in some embodiments, the connection 470 includes a power connection (e.g., to a latch and / or amplifier) and / or a control signal connection (e.g., a voltage reference to a comparator). In some embodiments, the power connection is illustrated by arrows between the components 419-1 and 419-2 and the PCA 451, the bidirectionality of the arrows indicating, in some embodiments, the effect of the PCA current consumption on the power supply voltage, e.g., causing a variation in the power supply voltage. In some embodiments, the exemplary elements 419-1, 419-2 include one or more of a driver circuit, a power supply circuit, and a ground.
[0106] While FIG. 4 illustrates sensing voltage fluctuations on connection 470 in some embodiments, in some embodiments current fluctuations are sensed and / or surges in power consumption are sensed.
[0107] In some embodiments, connection 470 includes connections to detection channels of multiple pixel circuits (eg, as described with respect to and / or illustrated in FIG. 7).
[0108] Optionally, in some embodiments, one or more pixel circuits of the PCA 451 include two channels (e.g., corresponding to channels 766, 768 of pixel circuit 712 of FIG. 7) through which the measurement signal 454 passes. In some embodiments, a first image channel emits an image signal and a second detection channel emits a detection signal, such that the PCA 451 emits a plurality of image signals 450 and a plurality of detection signals 458.
[0109] Optionally, in some embodiments, the detection circuit 422 detects electrical variations in connections to the pixel circuits at a pixel circuit-by-pixel circuit level, for example, by interfacing with a detection channel of the pixel circuit (e.g., as shown in and / or described with respect to FIG. 7 ), and is illustrated in FIG. 4 as a connection between the detection circuit 422 and the PCA 451.
[0110] In some embodiments, a global timing circuit (GTC) 418 receives a signal 464 from the detection circuit 422 when the detection circuit 422 identifies a pixel event. In some embodiments, upon receiving the signal 464 from the detection circuit 422, the GTC 418 generates a timestamp 434, which is then sent to the PMC 441.
[0111] In some embodiments, the GTC 418 includes a counter that is reset upon receiving a trigger 417 and stopped upon receiving a signal 464 from the detection circuit 422 to generate the time stamp 434 .
[0112] In some embodiments, the GTC 418 provides multiple timestamps for multiple signals 464 received sequentially, for example from the detection circuit 422. In some embodiments, the detection circuit 422 and / or the GTC 418 continuously provide detection and timestamps of pixel events. In some embodiments, the GTC 418 includes multiple counters, where, for example, the counters are reset by receiving a trigger 417 and stopped to generate one timestamp 434 for each of the multiple sequentially received signals 464 from the detection circuit 422.
[0113] A potential advantage of multiple timestamps is the ability to identify pixel events associated with self-reflections and / or different reflection paths.
[0114] Here, in some embodiments, the timestamp is used to identify that the reflection is a reflection of the laser light from an element of the system itself; for example, in some embodiments, such a reflection is identified as occurring very rapidly (e.g., less than a threshold amount of time) after the emission of the laser pulse.
[0115] Here, in some embodiments, the PMC 441 processes multiple timestamps to, for example, identify the path of the emitted laser pulse 423, for example, to identify direct reflection paths from an object and / or multiple reflection paths (e.g., from multiple objects).
[0116] Here, in some embodiments, the PMC 441 includes a rangefinder unit that uses the known timing 424 and timestamp 434 of the emission of the laser pulse to determine the distance (also referred to herein as "range") between the object and one or more parts of the system 400 (e.g., the light source 423 and / or the detector array 410).
[0117] In some embodiments, the PMC 441 generates a synchronized trigger signal 417 (also referred to herein as a "trigger signal," "trigger," or "synchronization signal"), which in some embodiments is used to control the timing of detection and / or time stamping in the detection circuit 422 and the GTC 418, respectively.
[0118] In some embodiments, the synchronization trigger 417 initiates a GTC 418 which is then sampled and / or terminated by the detection circuit 422 when a pixel event is detected and associates a timestamp 434 with the pixel event, the timestamp indicating, for example, the time elapsed since the start.
[0119] In some embodiments, the PMC 441 sends a control signal 424 to the light source 423 to control the operation of the light source 423. In some embodiments, a trigger 417 is used to control the timing of the emission of a laser pulse in the light source 423.
[0120] In some embodiments, the PMC 441 triggers the GTC 418 in response to activation of the laser, or in some embodiments, the triggering of the GTC 418 is independent of the control of the laser.
[0121] For example, in some embodiments, the PMC 441 initiates the GTC 418 using the trigger signal 417 in response to activation of the light source 423 .
[0122] In some embodiments, operation of the laser source 423 results in the generation of a detection enable signal 417 .
[0123] Here, in some embodiments, the laser source 423 generates a trigger signal 424, for example, upon and / or after emission of a laser pulse. When the trigger signal 424 is received by the PMC 441, the PMC 441 then generates and sends a detect enable signal 417 to enable the detector, in some embodiments, for example, after a known time offset relative to the operation time of the laser.
[0124] Here, in some embodiments, a detection enable signal 417 is generated (e.g., by the PMC 441) to enable the detector, for example, after a known time offset relative to the operation time of the laser. For example, the laser control signal 424 is sent before the trigger signal 417.
[0125] In FIG. 4, arrow 424 is depicted as a double-headed arrow to illustrate both detection enable signal 417 generation scenarios described in the previous two paragraphs.
[0126] In some embodiments, the known time offset is small, e.g., 1 ns to 100 μs, or lower, or higher, or intermediate range or duration, e.g., on the order of nanoseconds (e.g., 1 to 500 s, or lower, or higher, or intermediate range or duration), and the hoist, in some embodiments, is long enough to avoid sensing the emission as a pixel event.
[0127] In some embodiments, the PMC 441 includes an image processing unit (IPU) that receives and processes the imaging signal 450 to produce image data that, in some embodiments, is provided for display of an image associated with the data by one or more user interfaces 443.
[0128] Optionally, in some embodiments, additional information is output, eg, provided for display in user interface 443 , eg, range information determined from timing information 434 .
[0129] Optionally, in some embodiments, the PMC 441 includes a detection frame generation unit to construct a detection frame from the detection signal.
[0130] Here, in some embodiments, the detection frame is provided for display, for example, in the user interface 443. For example, in some embodiments, the detection frame information is overlaid on the image displayed in the user interface 443.
[0131] Optionally, in some embodiments, the detection circuit 422 and / or the GTC 418 produces a signal having an indication of the intensity of the sensed electrical variation in the connection to the pixel circuit, in some embodiments, the intensity indicating the number of pixels detecting the laser signal (e.g., the number of pixels having a pixel event).
[0132] In some embodiments, the intensity signal is used to identify and / or verify the laser source being detected (see, e.g., step 308 of FIG. 3). In some embodiments, the intensity signal is used along with a timestamp, e.g., to determine range (see, e.g., step 308 of FIG. 3), where, e.g., a higher intensity is taken to indicate a smaller range, e.g., the closer to the target, the more pixels are involved in the detection.
[0133] In some embodiments, the system 400 includes a ROIC 411, which in some embodiments hosts the PCA 451, and optionally one or more portions of the detection circuit 422, the GTC 418, and the PMC 441.
[0134] FIG. 5 is a method of imaging and detection according to some embodiments of the present disclosure.
[0135] FIG. 6 includes a simplified schematic diagram of imaging according to some embodiments of the present disclosure.
[0136] FIG. 6 illustrates an emitted laser pulse 658 reaching an object 656 within the FOV of the detector array, and the resulting image 660 and detection frame 662, both produced using detector array measurement data of the FOV.
[0137] In some embodiments, image 660 provides context as to where in space the laser spot (e.g., and therefore the target) is located (e.g., as corresponding to the positive region of detection frame 662).
[0138] Optionally, range information is displayed on and / or with the detection frame 662 and / or image 660. For example, as described with respect to step 510 and / or step 512.
[0139] In some embodiments, the detection and capture frames are displayed over time, for example as a video feed, for example a detection video including multiple detection frames, or a capture video including multiple images.
[0140] 5, at 500, in some embodiments, timing information is received regarding the emission of a laser pulse. For example, referring to FIG. 6, the timing of the emission of a laser pulse 658 is shown. Here, in some embodiments, the light source system is separate from the detection system, e.g., a trigger signal is sent from the light source system to the detection system. In some embodiments, the emitted laser light has a narrow beam, referred to herein as a "spot" or "laser spot." In some embodiments, an object 656 reflects a portion of the laser pulse 658 toward a detector array.
[0141] At 502, in some embodiments, electrical variations in the connection signal are related to the arrival of a reflected laser pulse at a detector array.
[0142] At 504, in some embodiments, the light is detected using an array of detectors, where multiple detectors produce multiple measurement signals.
[0143] In some embodiments, the detected light is ambient light. In some embodiments, the detected light includes reflected laser light pulses. In some embodiments, the detected light includes reflected illumination light (e.g., where the system includes an illumination source other than a pulsed laser light source, such as illumination with a broader range light source, e.g., infrared and / or visible light).
[0144] In some embodiments, steps 502 and 504 are performed simultaneously.
[0145] At 505, in some embodiments, the range between the object 656 and the detector array is determined using the timing of the electrical variations relative to the emission time of the laser pulse 658.
[0146] At 506, in some embodiments, the measurement signals are filtered to generate detection data, for example for each pixel circuit and / or detector, and the detection data is processed to generate a detection frame 662 indicative of reflection of the laser light 658 from the object 656.
[0147] For example, referring to FIG. 7 , for multiple pixel circuits 712, associated detection signals 754 pass through the pixel circuit's detection channel 768, and then, in some embodiments, the detection data for one or more pixel circuits 712 is processed to generate a detection frame 662.
[0148] At 508, in some embodiments, the measurement signals are processed (e.g., accumulated and / or integrated) to produce image data (e.g., for each pixel circuit and / or detector), and the image data is processed to produce an image 660 of the object 656.
[0149] For example, referring to FIG. 7, for multiple pixel circuits 712, the associated detection signal 754 passes through the image channel 766 of the pixel circuit, and then, in some embodiments, the image data for each pixel circuit is processed to produce image 660.
[0150] In some embodiments, steps 506 and 508 are performed simultaneously, e.g., the measurement signal is directed to the imaging channel and the detection channel, e.g., by the same element (e.g., front-end circuitry 725 directs the signal to both the imaging channel 766 and the detection channel 768 in FIG. 7).
[0151] At 510, optionally, in some embodiments, the detection data is combined with timing data. For example, in some embodiments, range information is provided along with the detection data (e.g., a detection frame), and the timing data (e.g., range information) in some embodiments is associated with individual pixels of the detection frame. In some embodiments, the range information is displayed along with the detection data, e.g., the range information is displayed along with the detection frame, e.g., the detection frame is annotated to indicate distances to portions (e.g., pixels) of the detection frame.
[0152] At 512, optionally, in some embodiments, the timing data is combined with the image data, e.g., in addition to or instead of being combined with the detection data (e.g., as described in step 510), where, for example, in some embodiments the timing data and the image data are provided together, e.g., each portion of the timing data is associated with one or more image pixels. For example, if the provided data is used to display range information with the image, e.g., the image may be annotated to indicate distance to portions (e.g., pixels) of the image.
[0153] In some embodiments, the associated timing data and image data are for the same time period, however, in some embodiments the detection frame rate is higher than the imaging frame rate, where in some embodiments multiple pixel events sensed over multiple detection periods are associated with (e.g., optionally provided and / or displayed with) image data (e.g., a single image).
[0154] FIG. 7 is a simplified schematic diagram of a portion of a system 700 including a plurality of pixel circuits 712 and a detection circuit 722, according to some embodiments of the present disclosure.
[0155] In some embodiments, each pixel circuit receives signals from one or more detectors (e.g., detector 210-1 in FIG. 2A), where, for ease of illustration, a single detection signal 754 is illustrated in FIG. 7 as being received by pixel circuit 712, where in some embodiments detection signal 754 includes photocurrent indicative of detector pixels affected by a laser pulse and / or photocurrent indicative of pixels illuminated by an imaging source, such as infrared light and / or ambient light.
[0156] In some embodiments, the pixel circuit 712 includes a front-end circuit 725 as detailed in US Pat. No. 9,215,386 or IL262372, both of which are incorporated by reference in their entireties.
[0157] Here, in some embodiments, the front-end circuitry 725 is configured to generate and / or obtain a respective electrical signal indicative of the pixel photocurrent, where the front-end circuitry 725 in some embodiments is optionally configured with any suitable type of photodetection front-end circuitry, such as a direct injection (DI) circuit, a buffered direct injection (BDI) circuit, a capacitive trans-impedance amplification (CTIA) circuit, a source follower (SF) circuit, and combinations thereof.
[0158] Here, in some embodiments, the front-end circuit 725 receives the detection signal 754 .
[0159] In some embodiments, the detection signal 754 is output from the front-end circuit 725 as an image signal 750 (e.g., along with other imaging channel outputs of the pixel circuit 711) after passing through an image channel 766 that includes, for example, an accumulator 726 that integrates the signal and then a buffer 727 that buffers the integrated signal, where in some embodiments the accumulator 726 integrates the signal.
[0160] In some embodiments, the detection signal 754 passes from the front-end circuit 725 to a detection channel 768. The detection channel 768 includes a pre-processing unit 728 configured in some embodiments to detect abrupt, short (e.g., over less than 10 μs, or less than 5 μs, or less than 1 μ, or over a lower, higher, or intermediate duration, or range) changes in photocurrent (e.g., most typically caused by a laser pulse). In some embodiments, the pre-processing unit 728 is configured for other high-intensity illumination sources. In some embodiments, the pre-processing unit 728 includes a band-pass filter configured to pass signals within a predetermined frequency band corresponding to the frequency of the laser source (e.g., a frequency band corresponding to the frequency band of the light source 423 in FIG. 4). Potentially, such filtering ensures that the majority of the photocurrent passed by the pre-processing unit 728 originates from the selected source (e.g., a laser source), except for, for example, a small amount of noise that falls in the same frequency band.
[0161] In some embodiments, the detection channel 768 includes a latched comparator 729 that outputs a signal when it receives an input that exceeds a threshold.
[0162] In some embodiments, the detection circuit 722 intercepts a connection 719 to the PCA 751 , and in some embodiments, the connection 719 is a shared electrical connection to multiple pixel circuits 712 of the PCA 751 .
[0163] Here, detection circuitry 722 receives a signal 770 indicative of the electrical connection voltage level and / or the current passing through electrical connection 719 and detects the timing of the electrical variations associated with pixel events.
[0164] In some embodiments, connection 719 is a power connection where surges in power consumption to one or more elements of pixel circuit 712 are used to record and / or measure the timing of pixel events.
[0165] In some embodiments, the connection 719 is a reference voltage or current reference, for example, supplied to the same components of the multiple pixel circuits. For example, in some embodiments, the connection 719 includes a power supply to a latch (not shown), for example, multiple latches, for example, associated with the multiple pixel circuits, for example, one for each pixel circuit of the multiple pixel circuits (e.g., as described below). For example, additionally or alternatively, in some embodiments, the connection 719 includes a power supply to an amplifier (not shown in some embodiments where the detection channel 768 includes an amplifier), for example, multiple amplifiers, for example, associated with the multiple pixel circuits, for example, an amplifier for each pixel circuit of the multiple pixel circuits. Alternatively or additionally, in some embodiments, the connection 719 includes a connection to a pre-processing unit 728, for example, multiple pre-processing units, for example, associated with the multiple pixel circuits, for example, a pre-processing unit for each pixel circuit of the multiple pixel circuits.
[0166] Alternatively or additionally, in some embodiments, connection 719 includes a connection for a reference (e.g., a voltage reference) provided to a comparator, such as comparator 730. Alternatively or additionally, in some embodiments, connection 719 includes a connection to a ground connection for the plurality of pixel circuits. In some embodiments, connection 719 includes a connection to a control signal to one or more elements of the plurality of pixel circuits.
[0167] For example, in an exemplary embodiment, detection circuit 772 (e.g., as illustrated by dashed line 770a) blocks the output of power supply 719 (which in some embodiments is a driver, e.g., an on-chip driver) before it is provided to one or more (e.g., each) latched comparators 729. Here, in some embodiments, upon a pixel event that results in, for example, a change of state of latch 731, a power surge (e.g., in a voltage driver, not shown) to one or more latches 731 and / or latched comparators 729 is used to sense the current surge and / or voltage drop resulting from the pixel event.
[0168] In some embodiments, electrical variations directly associated with a pixel event (e.g., a change in state of latch 731) result in electrical variations elsewhere in the circuit. For example, crosstalk (e.g., associated with parasitics, e.g., parasitic capacitance) may result in variations that additionally appear in the circuit. For example, in some embodiments, a change in state of latch 731 and the associated electrical variations to the latch may, in some embodiments, result in a measurable variation in another connection (e.g., in the connection to comparator 730), where the measurable variation is detected, for example, by detector 722, in some embodiments to determine the timing of the pixel event.
[0169] In some embodiments, instead of or in addition to sensing a surge in power consumption to the latch 731 (e.g., multiple latches 731, each associated with a single pixel circuit 712) and / or the latched comparator 729, a power consumption surge is sensed in one or more of the power supplies to elements of the front-end circuitry 725 and elements of the pre-processing unit 728.
[0170] In some embodiments, the comparator 730 is a latched comparator 729 that includes a latch 731. The latch 731 is, in some embodiments, a bistable latch 731 that upon receiving a signal from the comparator 730, changes state from an initial first level (typically a logic "0") to a second level (typically a logic "1"), latches the new state, and outputs the second level, for example, if the signal 754 includes a pixel event. For example, multiple latches, each associated with a pixel circuit 712 of the PCA 751, produce a binary indication of whether the associated detector has experienced a pixel event (e.g., whether it has been affected by laser light). Here, in some embodiments, the PCA 751 outputs multiple latched comparator outputs 758, each corresponding, in some embodiments, to one or more detection signals.
[0171] In some embodiments, each pixel circuit of the PCA 751 has both channels 766, 768, e.g., an image has a one-to-one correspondence with a detection frame. Alternatively, in some embodiments, fewer than each pixel circuit of the PCA 751 has detection channels 768, e.g., a detection frame has a lower resolution than an image.
[0172] FIG. 8 is a detection method according to some embodiments of the present disclosure.
[0173] At 800, in some embodiments, detection is disabled, for example, before the start of a GTC (e.g., GTC 118 in FIG. 1, e.g., GTC 418 in FIG. 4, e.g., GTC 718 in FIG. 7).
[0174] At 802, in some embodiments, the detection circuit is synchronized with the emission of the laser pulse, for example, the light source unit sends a signal (e.g., a trigger signal) to the detection circuit at (and / or before) the emission of the laser pulse.
[0175] At 804, in some embodiments, upon (and / or synchronized with) emission of the laser pulse, one or more portions of the detection channels are enabled, for example, by a trigger signal (e.g., trigger signal 417 in FIG. 4, e.g., trigger signal 717 in FIG. 7). Referring now to FIG. 7, in some embodiments, pre-processing unit 728 and / or latched comparator 729 are enabled, for example, by synchronization signal 717, which in some embodiments is normally disabled.
[0176] In some embodiments, upon emission of a laser pulse, the detection circuitry and / or the GTC are enabled, for example, by a trigger signal (eg, trigger signal 417 in FIG. 4, eg, trigger signal 717 in FIG. 7).
[0177] A potential advantage of enabling the detection circuitry upon emission of the laser pulse is the potential reduction in false detection of pixel events associated with, for example, noise and / or light reflections.
[0178] At 806, optionally, in some embodiments, pixel event detection is disabled, for example, after a frame time.
[0179] Here, in some embodiments, detection may be enabled, for example, for multiple frames, at the start of each frame and disabled at the end of each frame.
[0180] FIG. 9A is a simplified schematic diagram of a detection circuit 922 according to some embodiments of the present disclosure.
[0181] In some embodiments, the detection circuit 922 receives a power supply signal 970, which in some embodiments includes one or more features of power supply signal 170 of Figure 1, and / or power supply signal 470 of Figure 4, and / or power supply signal 770 of Figure 7. For example, in some embodiments, the power supply signal 970 is the output of a driver that provides power to one or more pixel circuits, e.g., a latched comparator of the pixel circuit.
[0182] Here, in some embodiments, the power supply signal includes a connection to a power supply for multiple latched comparators, each latched comparator associated with a pixel circuit, for example, referring to FIG. 7, latched comparator 729 of pixel circuit 712 provides power supply signal 770 (together with other pixel circuits).
[0183] In some embodiments, the power supply signal 770 is a reference voltage V REF1 where in some embodiments the comparison is performed by a comparator 933. In some embodiments, the voltage of the power supply signal 970 is compared to V REF , a signal is sent from the detection circuit 922, for example, to GTC 918 (which in some embodiments includes GTC 118 of FIG. 1 and / or one or more features of GTC 118 of FIG. 1) (e.g., comparator 933 changes state).
[0184] FIG. 9B is a simplified schematic diagram of a detection circuit 923 according to some embodiments of the present disclosure.
[0185] Here, in some embodiments, the detection circuit 923 is connected to a power source 919 and a pixel circuit array (PCA) 951 .
[0186] In some embodiments, a current surge in the power supply consumption can be detected, for example, by measuring the power supply current through the charge sensing unit 932 (e.g., as a change in voltage ΔV) and comparing the voltage change input with a reference voltage V, for example, by a comparator 916. REF Here, in some embodiments, the current is identified by comparing it to a threshold (e.g., a characteristic of the charge sensing unit 932 and / or V REF If the voltage Vcc rises above a threshold defined as the value of Vcc, a signal (eg, comparator 916 changes state) is issued from detection circuit 923 (eg, to GTC 918).
[0187] Here, in some embodiments, the charge sensing unit 932 includes one or more resistors and / or capacitors and / or amplifiers. For example, in some implementations, the charge sensing unit 932 includes a resistor to convert the current supply signal 919 to the PCA 951 into a voltage for comparison in the comparator 916.
[0188] FIG. 9C is a calibration method according to some embodiments of the present disclosure.
[0189] At 900, in some embodiments, data regarding the light source is received. For example, the received data may include one or more characteristics such as those described with respect to step 300 of FIG.
[0190] At 902, in some embodiments, multiple timestamps are generated, each timestamp corresponding to a detection of light.
[0191] At 904, in some embodiments, one or more thresholds (e.g., V in FIG. 9A and / or FIG. 9B ) are REF ) is modified until the detection circuitry provides at most a single detection for an emitted laser pulse, for example during a frame time.
[0192] Alternatively or additionally, in some embodiments, one or more thresholds are varied and / or selected to balance the trade-off between potentially reducing false positive rates and increasing sensitivity (e.g., of the range of detections used).
[0193] Here, in some embodiments, a threshold is set for detection only at a particular intensity corresponding to pixels experiencing a pixel event.
[0194] FIG. 10 is a simplified schematic block diagram of image and post-processing circuitry 1035 according to some embodiments of the present disclosure.
[0195] In some embodiments, the imaging, and post-processing unit (IPPU) 1035 is external to the ROIC, such as the ROIC 111 of Figure 11. Alternatively, in some embodiments, at least a portion of the IPPU 1035 is hosted by an integrated circuit that hosts the ROIC according to aspects of the present disclosure.
[0196] In some embodiments, the IPPU is hosted, at least in part, by a PMC (eg, PMC 441 in FIG. 4, eg, PMC 741 in FIG. 7).
[0197] In some embodiments, the IPPU 1035 includes an imaging channel 1036, where the imaging channel 1036 receives a plurality of image signals 1050, e.g., image signals from each pixel circuit (e.g., image signal 450 of FIG. 4, e.g., image signal 750 of FIG. 7). In some embodiments, the imaging channel 1036 processes the image signals 1050 to generate an image (e.g., image 660 of FIG. 6). Here, in some embodiments, the imaging channel 1036 generates a video frame output 1060 that includes the plurality of images. In some embodiments, image processing is performed (e.g., by the imaging channel 1036) as described in U.S. Pat. No. 9,215,386, the entirety of which is incorporated by reference.
[0198] In some embodiments, the IPPU 1035 includes a detection channel 1037 that receives a plurality of latch outputs 1058 (e.g., corresponding to output 758 of FIG. 7) and processes the latch outputs 1058 to produce a detection frame (e.g., detection frame 662 of FIG. 6), where in some embodiments the detection channel 1037 produces a video output 1062 from the plurality of detection frames.
[0199] In some embodiments, detection channel processing is provided by a read multiplexer 1038 and a frame maker 1039, where, for example, the latch output 1058 is coupled to an input of the read multiplexer 1038. The read multiplexer 1038, in some embodiments, provides the binary logic level of each latch (e.g., in sequence) to the frame maker 1039, which, in some embodiments, reconstructs a detection frame (e.g., detection frame 662 of FIG. 6).
[0200] In some embodiments, a detection frame (e.g., detection frame 662 in FIG. 6) corresponds to an image output by imaging channel 1036 (e.g., image 660 in FIG. 6), where, for example, pixels or clusters in the detection frame with a logical "1" value correspond to locations in the image that were affected by the laser spot.
[0201] In some embodiments, the range finder 1020 receives a timestamp 1034 (e.g., from a GTC, e.g., GTC 121 of FIG. 1, e.g., GTC 421 of FIG. 4, e.g., GTC 721 of FIG. 7), e.g., a timestamp 1034 associated with each detection frame. In some embodiments, the range finder 1020 determines a range, e.g., based on the timestamp data 1034.
[0202] In some embodiments, the range data is combined with the detection data, e.g., where in some embodiments the range data is combined with a detection frame, e.g., provided together, e.g., for display. For example, in some embodiments, the frame maker 1039 relays the timestamp data 1034 along with information identifying the active pixels or clusters, e.g., to the video driver 1040 to create a video frame showing the active pixels or clusters in their appropriate spatial context along with their respective range data.
[0203] In some embodiments, the IPPU 1035 includes a controller 1041 configured to control the timing of the display. In some embodiments, the controller 1041 defines the time for the display of a new detection frame and synchronizes it with the display of a corresponding video frame output from the imaging channel 1036.
[0204] In some embodiments, the controller 1041 determines, for example by the frame maker 1039, how the timestamp 1034 is combined with the detection frame.
[0205] For example, in some embodiments, the detection frame comprises a frame header that acts as a preamble to the detection data for each pixel circuit detection channel (e.g., detection data representing the level of each latch, e.g., latch 731 in FIG. 7). In some embodiments, the frame header includes general information of the frame setup and / or multiple or single timestamp data or a "timestamp not found" indication if no pixel event was registered by the GTC in the corresponding current detection frame period.
[0206] In some embodiments, the image video frames output 1060 by the imaging channel 1036 (e.g., including multiple images, e.g., image 660 of FIG. 6) and the detection video output 1062 from the video driver 1040 (e.g., including multiple detection frames) are displayed separately, e.g., as two different videos, e.g., on two or more displays. Alternatively or additionally, the two videos are combined, e.g., the image and detection frames are provided together, e.g., each image is associated with one or more detection frames, e.g., to illustrate (e.g., highlight) on the image video where an object was illuminated by a laser spot.
[0207] FIG. 11 is a method according to some embodiments of the present disclosure.
[0208] At 1100, in some embodiments, timing information regarding the emission of a laser pulse toward a target is received (eg, according to one or more features of step 500 of FIG. 5).
[0209] At 1102, in some embodiments, a detector array senses light from a FOV that includes the target, where the sensor signals are processed to produce, for each detector, detection data (and optionally image data) indicative of the portion of the detector array that senses the first laser pulse reflected from the target.
[0210] At 1104, in some embodiments, a region of interest (ROI) is identified from the detection data. For example, the ROI is a sub-portion of the detector array that experienced a pixel event, and in some embodiments the sub-portion is a predetermined region of the detector array. For example, the ROI includes the pixel that experienced the pixel event.
[0211] At 1106, in some embodiments, the detection sensitivity for pixel circuits of the ROI is increased, where in some embodiments the detection sensitivity for pixel events is increased.
[0212] For example, by reducing the time constant of one or more portions of the detection channel of the pixel circuit of the ROI, where in some embodiments the time constant is reduced for one or more of the front-end circuit (e.g., front-end circuit 725 of FIG. 7) and / or pre-processing unit (e.g., pre-processing unit 728 of FIG. 7) and / or latched comparator (e.g., latched comparator 729 of FIG. 7) of the pixel circuit of the ROI. Wherein, in an exemplary embodiment, the time constant is reduced by increasing the current supply, for example, by changing a current reference value (also referred to herein as a "bias" value) provided to the PCA by one or more drivers, where, for example, the current reference value defines the current consumption of the front-end / pre-processing unit.
[0213] For example, alternatively or additionally, by reducing the number of rows and / or columns of pixel array circuitry used in detection to reduce the detection frame readout period. Reducing the frame duration potentially provides more accurate time stamps, e.g., more accurate distance measurements, e.g., at the expense of reduced spatial resolution.
[0214] At 1108, in some embodiments, timing information regarding the emission of a second laser pulse toward the target is received and step 1102 is repeated to produce a second (e.g., partial) detection frame having higher detection sensitivity in the ROI.
[0215] General matters As used within this document, the term "about" refers to ±20%. The terms "comprises," "comprising," "includes," "including," "having," and their conjugations mean "including but not limited to." The term "consisting of" means "including and limited to."
[0216] As used herein, the singular forms "a," "an," and "the" include the plural forms unless the context clearly dictates otherwise.
[0217] Within this application, various quantifications and / or expressions may include the use of ranges. The range format should not be construed as an inflexible limitation on the scope of the disclosure. Thus, descriptions containing ranges should be considered to have all possible subranges specifically disclosed as well as individual numerical values within that range. For example, descriptions of ranges such as 1-6 should be considered to specifically disclose subranges such as 1-3, 1-4, 1-5, 2-4, 2-6, 3-6, etc., as well as individual numbers within the stated range and / or subrange, for example, 1, 2, 3, 4, 5, and 6. Whenever a numerical range is given within this document, it is meant to include any cited numbers (fractional or integer) within the given range.
[0218] It should be understood that certain features that are described in the context of separate embodiments (e.g., for clarity) may also be provided in combination in a single embodiment. Various features of the disclosure that are described in the context of a single embodiment (e.g., for brevity) may also be provided separately or in any suitable subcombination or suitable for use in any other described embodiment. Features described in the context of various embodiments should not be considered essential features of those embodiments unless the embodiments are inoperable without those elements.
[0219] While this disclosure has been described in conjunction with specific embodiments thereof, it is evident that many alternatives, modifications, and variations will be apparent to those skilled in the art. Accordingly, this application is intended to embrace all such alternatives, modifications, and variations that fall within the spirit and broad scope of the appended claims.
[0220] All references (e.g., publications, patents, patent applications) mentioned herein are incorporated by reference in their entirety, as if each individual publication, patent, or patent application were individually indicated to be incorporated by reference herein. Citation or identification of any reference in this application should not be construed as an admission that such reference is available as prior art to the present disclosure. Additionally, any priority documents and / or documents related to this application (e.g., concurrent applications) are incorporated by reference herein in their entirety.
[0221] When section headings are used herein, they should not be construed as necessarily limiting.
Claims
1. 1. An imaging system, comprising: a photodetector pixel array configured to provide a plurality of light measurement signals of a field of view (FOV); a pixel circuit array (PCA) comprising a plurality of pixel circuits, each pixel circuit associated with a pixel of the photodetector pixel array and configured to receive one of the plurality of light measurement signals; at least one electrical connection to and shared by at least two pixel circuits of the plurality of pixel circuits, the at least two pixel circuits each associated with at least two detector pixels of the detector pixel array; and and a detection circuit configured to detect electrical variations associated with receipt at the photodetector pixel array of a pulse of laser light.
2. The imaging system of claim 1 , comprising a global timing circuit configured to time stamp the electrical variations.
3. 3. An imaging system as claimed in claim 1 or 2, wherein the connection is a power supply connection to the at least two pixel circuits.
4. 3. The imaging system of claim 1, wherein the connection is a reference voltage supplied to the at least two pixel circuits.
5. The imaging system of any one of claims 1 to 4, wherein the detection circuitry is configured to associate the electrical variation with one or more of the plurality of pixel circuits.
6. The imaging system of any one of claims 2 to 5, wherein the global timing circuit is configured to associate the time stamp with one or more of the plurality of pixel circuits.
7. The imaging system according to any one of claims 1 to 6, wherein two or more of the plurality of pixel circuits each have one of the plurality of detection channels.
8. The imaging system of claim 7 , wherein the multiple detection channels provide detection data.
9. 9. The imaging system of claim 8, wherein the plurality of detection channels are configured to pass the detection data to one or more frame makers for construction of a detection frame, each detection channel being associated with a pixel of the detection frame.
10. The imaging system of any one of claims 7 to 9, wherein the timestamp is associated with one or more pixels of the detection frame.
11. The imaging system according to any one of claims 7 to 10, wherein the connection is a connection to two or more detection channels of the plurality of detection channels.
12. The imaging system of any one of claims 7 to 10, wherein at least a portion of the plurality of pixel circuits each include an imaging channel configured to provide image data.
13. The imaging system of claim 12 , wherein the detection data and the image data are provided in association with each other.
14. The imaging system of claim 13 , wherein each pixel of the detected data is associated with one or more pixels of the image data.
15. An imaging system according to any one of claims 2 to 14, configured to communicate with a laser source configured to direct a pulse of laser light towards the FOV at a known time.
16. 16. The imaging system of claim 15, wherein the reception at the photodetector pixel array is of a portion of a pulse of laser light emitted by the laser source and reflected by an object within the FOV.
17. 17. The imaging system of claim 15 or 16, comprising processing and memory circuitry configured to use the timestamp and the known time to determine a range between one or more components of the system and the object.
18. the detection circuitry is configured to detect a plurality of surges in power consumption; The imaging system of any one of claims 2 to 17, wherein the global timing circuit is configured to provide a plurality of time stamps, one time stamp for each of the plurality of surges.
19. The imaging system of any preceding claim, wherein the PCA includes a plurality of pixel circuits, each of the plurality of pixel circuits having an imaging channel.
20. A processing and memory circuit (PMC) is provided, 20. The imaging system of claim 19, wherein each imaging channel is configured to pass image data to an image processing unit for construction of an image.
21. 20. The imaging system of claim 18 or 19, comprising a processing and memory circuit (PMC) configured to use the multiple timestamps to identify a laser source.
22. An imaging system according to any one of claims 2 to 21, wherein the global timing circuit comprises a counter, the counter value at the time of detection of the variation providing the time stamp.
23. The imaging system of claim 22 , wherein the counter is reset upon detection of the variation.
24. the global timing circuit comprises a counter that is started upon detection of the variation; An imaging system according to any one of claims 2 to 21, wherein the counter value upon detection of a subsequent second variation provides a time measure between detected variations.
25. a pixel circuit array (PCA) comprising a plurality of pixel circuits, each pixel circuit configured to receive a light measurement signal from a detector of the photodetector pixel array; a detection circuit configured to detect an electrical variation associated with receipt of a pulse of laser light at the photodetector pixel array; a global timing circuit configured to timestamp the electrical variations in power consumption.
26. at least one driver configured to provide power to the plurality of pixel circuits; 26. The ROIC of claim 25, wherein the detection circuitry is configured to detect the electrical variation in power consumption in one or more connections between the driver and the plurality of pixel circuits.
27. 1. A method of imaging, comprising: acquiring a plurality of measurement signals of a field of view (FOV) using an array of photodetectors, each detector producing one of the plurality of measurement signals; detecting and time-stamping electrical variations associated with receipt of a pulse of laser light at the array of photodetectors.
28. 1. An imaging system, comprising: a photodetector pixel array configured to provide a plurality of light measurement signals of a field of view (FOV); a pixel circuit array (PCA) comprising a plurality of pixel circuits, each pixel circuit associated with a pixel of the photodetector pixel array and configured to receive one of the plurality of light measurement signals; at least one electrical connection to and shared by at least two pixel circuits of the plurality of pixel circuits, the at least two pixel circuits each associated with at least two detector pixels of the detector pixel array; and a detection circuit configured to detect an electrical variation associated with receipt of a pulse of laser light at the photodetector pixel array; a global timing circuit configured to provide a timestamp of the electrical variations, the timestamp being associated with one or more of the plurality of pixel circuits; a plurality of detection channels, each associated with one of the plurality of pixel circuits and configured to provide detection data, each of the pixels being associated with one of the plurality of pixel circuits; a plurality of imaging channels, each associated with one of the plurality of pixel circuits and configured to provide image data, each of the imaging channels being associated with one of the plurality of pixel circuits;
