A differential image sensor with digital pixel storage
By designing an acquisition circuit with digital pixel storage in the differential image sensor, resource sharing between pixels and analog circuit parameter modulation are realized, the problems of reduced performance and low modulation efficiency in the prior art are solved, and high resolution and cost-optimized sensors are realized.
Patent Information
- Application Number
- CN202111396954.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-11-23
- Publication Date
- 2025-06-17
- Estimated Expiration
- 2041-11-23
AI Technical Summary
When existing differential image sensors with digital pixel storage use digital storage and event calculation in time sequence, it is difficult to realize resource sharing between pixels without reducing performance, and the analog circuit parameter modulation efficiency is low, making it difficult to achieve small pixel structure and high-resolution sensors with area optimization.
A differential image sensor with digital pixel storage is designed, and a pixel array and multiple acquisition circuits are adopted. Each acquisition circuit includes a sensor circuit, an analog-to-digital conversion circuit, a digital storage circuit, a digital comparison circuit and a digital output circuit. The modulation of analog circuit parameters is realized through digital control, and resource sharing is realized in the pixel circuit.
While using digital storage and event calculation in time sequence, resource sharing among pixels does not reduce performance, improves the efficiency of analog circuit parameter modulation, and realizes area-optimized small pixel structure and high-resolution cost-optimized sensors.
Smart Images

Figure CN114095677B_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of image sensors, and particularly relates to a differential image sensor with digital pixel storage. Background Art
[0002] In the prior art, image sensors in which each pixel or each small subset of pixels has an ADC are well-known and are commonly used in applications that perform important processing in pixels, such as X-ray particle track tracing or satellite imaging.
[0003] In addition, image sensors that use image pixel-level change detection, storage, and comparison in the analog domain to generate events are well-known. Comparison and storage in the analog domain have advantages and disadvantages compared to digital methods. The advantages are that they can be implemented based on a compact structure, while the disadvantages include gradual storage degradation, including "hot pixels", sensitivity to mismatches, and reduced flexibility of the photo-to-electric conversion function.
[0004] Image sensors that share circuitry between pixels are well-known. For example, Suh et al. proposed it in 2020. Sharing is crucial in image sensor design, and based on sharing, a dense pixel array and high pixel resolution can be created.
[0005] CMOS image sensors are mass-produced in a specialized process in an optimized foundry process, and CMOS digital logic devices are mass-produced in an optimized foundry process. The density of both processes is increasing, especially the density of the digital logic process. The increased density allows for an increase in the digital circuitry associated with the pixel circuits in the image sensor. In addition, digital storage in the front end of the pixel circuit has advantages in terms of storage fidelity and subsequent processing at the storage level.
[0006] Serrano Gotalredoña et al. solved the problem of mismatches in the standard analog storage implementation of dynamic vision sensors that use transistors in subthreshold operation. Since the operation in this transistor mode can only work properly within a limited range, they use global analog feedback to the analog part of the acquisition circuit of the entire array to obtain satisfactory operation. Summary of the Invention
[0007] An incremental image sensor with digital pixel storage that may need improvement. In particular, it may be necessary to use digital storage and event calculation in a chronological manner, which is particularly suitable for resource sharing between pixels without degrading performance. In particular, it may be necessary to modulate analog circuit parameters based on the stored digital levels or event outputs, as this feedback is effectively achieved through switches under digital control. In particular, it may be necessary to modulate the analog circuit parameters based on the pixel digital levels or event outputs stored locally, as this feedback is effectively achieved with switches under digital control. In particular, it may be necessary to be able to implement a small pixel structure for area optimization, resulting in a high-resolution and cost-optimized sensor. In particular, it may be necessary to improve the incremental image sensor with a pixel circuit that has digital storage of the representation of the previous illumination intensity in the pixel. In particular, it may be necessary to utilize the advantages of digital pixel conversion and storage to implement a small pixel structure for area optimization, resulting in a high-resolution and cost-optimized sensor.
[0008] The subject matter of the independent claims can meet this need. Advantageous embodiments are defined in the dependent claims.
[0009] One aspect of the present invention relates to an incremental image sensor with digital pixel storage, comprising a pixel array and a plurality of acquisition circuits, the pixel array including a plurality of unit pixels, each of the acquisition circuits corresponding to at least one unit pixel; wherein, each of the acquisition circuits includes:
[0010] At least one sensor circuit, each of the sensor circuits including a light sensor, the light sensor being configured to generate a sensor signal VSIG according to a light signal illuminating at least one pixel corresponding to the light sensor;
[0011] At least one analog-to-digital conversion circuit, the analog-to-digital conversion circuit being configured to generate a current digital signal according to the sensor signal VSIG;
[0012] At least one digital storage circuit, the digital storage circuit being configured to store a previous digital signal, wherein the previous digital signal is a digital signal generated according to a previous sensor signal VSIG;
[0013] At least one digital comparison circuit, the digital comparison circuit being configured to compare the level of the current digital signal with the level of the previous digital signal and determine whether the current digital signal has a changing level;
[0014] At least one digital output circuit, the digital output circuit being configured to generate an event signal and output it when the current digital signal has a changing level.
[0015] In some embodiments, one acquisition circuit corresponds to at least two adjacent unit pixels.
[0016] In some embodiments, the sensor circuit generates the sensor signal VSIG in response to a control signal, and the sensor signal VSIG changes its correspondence with the light intensity based on the control of the control signal, and / or,
[0017] The sensor circuit generates the sensor signal VSIG in response to a control signal during operation, and the sensor signal VSIG changes its correspondence with the light intensity based on the control of the control signal, wherein one control signal acts on the entire pixel array or a local unit pixel in the pixel array.
[0018] In some embodiments, the sensor signal VSIG generated by the sensor circuit has any one of the following correspondence relationships with the light intensity:
[0019] The sensor signal VSIG is linearly correlated with the light intensity, or,
[0020] The sensor signal VSIG is non-linearly correlated with the light intensity, wherein the non-linear correlation includes but is not limited to logarithmic variation; or,
[0021] The sensor signal VSIG has a combined relationship of non-linear and linear correlation with the light intensity; wherein the above correspondence relationship changes in response to a control signal.
[0022] In some embodiments, a) the analog-to-digital conversion circuit includes a comparator, and the comparator is used to compare the sensor signal VSIG with any one of the following scanning signals:
[0023] aa) An analog scanning input signal;
[0024] bb) Successive analog scanning input signals, wherein each analog scanning input signal provides a different ramp signal slope;
[0025] Wherein the single or successive analog scanning input signals are used to be provided to at least one of the analog-to-digital conversion circuits; and / or,
[0026] b) The analog-to-digital conversion circuit is further used to provide at least one digital code parallel to the scanning signal to at least one unit pixel, and the digital code includes but is not limited to Gray code.
[0027] In some embodiments, the scanning signal is a linear ramp, or,
[0028] The scanning signal is a non-linear ramp, or,
[0029] The scanning signal changes during operation, and / or,
[0030] The period of the scanning signal changes during operation, and / or,
[0031] The scanning signal is interrupted at a specific time during operation, and the specific time is set or preset during operation.
[0032] In some embodiments, at least one reference pixel is further included, and the reference pixel is used to define a ramp signal; wherein, the reference pixel is disposed outside the pixel array.
[0033] In some embodiments, the digital comparison circuit compares the level with that of the previous digital signal during the scanning of the analog signal; or,
[0034] The digital comparison circuit compares the level with that of the previous digital signal after the scanning of the analog signal.
[0035] In some embodiments, the digital comparison circuit uses dynamic logic to compare levels, or,
[0036] The digital comparison circuit uses static logic to compare levels.
[0037] In some embodiments, the digital output circuit is used to output the output signal according to the comparison result of the digital comparison circuit in adjacent pixels, or,
[0038] The digital output circuit is used to generate an output signal according to a function of adjacent pixels in a fixed configuration or a function in a configuration that changes during operation, wherein the function includes but is not limited to an averaging function.
[0039] In some embodiments, the digital output circuit is used to generate an event signal according to the outputs of adjacent pixels, or,
[0040] The output circuit is used to generate an event signal according to the levels stored in adjacent pixels, or,
[0041] The output circuit is used to generate an event signal according to a plurality of pre-stored stored values.
[0042] In some embodiments, the digital output circuit is used to generate an event signal indicating the direction of a level change, and / or,
[0043] The digital output circuit is applied to generate an event signal indicating only one change direction of one changed level, and / or,
[0044] The digital output circuit is used to generate an event signal indicating the amplitude of a changed level, and / or,
[0045] The digital output circuit is used to generate an event signal indicating the light intensity before and / or after a level change.
[0046] In some embodiments, the digital storage circuit is configured to provide a stored previous digital signal at an output line of the pixel array, and / or,
[0047] the digital storage circuit is configured to selectively provide a stored previous digital signal for a unit pixel having an event output at an output line of the pixel array, and / or,
[0048] the digital storage circuit is configured to provide a stored previous digital signal at an output line using a time column line, and / or,
[0049] the digital storage circuit is configured to write the stored previous digital signal into a unit pixel, and / or,
[0050] the digital storage circuit is configured to write a data stream into the previous digital signal;
[0051] the digital storage circuit is configured to write from a data stream as an event stream into the stored previous digital signal.
[0052] In some embodiments, the sensor circuit receives feedback corresponding to a digital level stored in the digital storage circuit or a digital level of an adjacent pixel stored in the digital storage circuit from the digital storage circuit, and the sensor circuit generates a sensor signal VSIG based on the feedback, and / or,
[0053] the analog-to-digital conversion circuit receives feedback from a level of a stored previous digital signal or a level of a previous digital signal stored in an adjacent unit pixel, and adjusts a current digital signal output according to the feedback. BRIEF DESCRIPTION OF THE DRAWINGS
[0054] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.
[0055] Figure 1 It is a circuit structure block diagram of a differential image sensor with digital pixel storage provided by an embodiment of the present invention.
[0056] Among them, the reference numerals in the drawings:
[0057] 100, sensor circuit; 200, analog-to-digital conversion circuit; 300, digital storage circuit; 400, digital comparison circuit; 500, digital output circuit. DETAILED DESCRIPTION OF THE EMBODIMENTS
[0058] Embodiments of the present invention will be described in detail below. Examples of the embodiments are shown in the accompanying drawings, where like or similar reference numerals designate like or similar elements or elements having like or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to explain the embodiments of the present invention and should not be construed as limiting the present invention.
[0059] In the description of the embodiments of the present invention, it should be understood that the orientation or positional relationship indicated by the terms "length", "width", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc. is based on the orientation or positional relationship shown in the drawings, and is only for the convenience of describing the embodiments of the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and thus should not be construed as limiting the present invention.
[0060] In addition, the terms "first" and "second" are only used for descriptive purposes and should not be construed as indicating or implying relative importance or implicitly specifying the quantity of the indicated technical features. Thus, features defined with "first" and "second" may explicitly or implicitly include one or more of such features. In the description of the embodiments of the present invention, "a plurality" means two or more unless otherwise specifically defined.
[0061] In the embodiments of the present invention, unless otherwise clearly defined and limited, the terms "mounted", "connected", "coupled", "fixed", etc. should be construed in a broad sense. For example, it may be a fixed connection, a detachable connection, or integrated; it may be a mechanical connection or an electrical connection; it may be directly connected or indirectly connected through an intermediate medium, and it may be the internal communication of two elements or the interaction relationship between two elements. For those of ordinary skill in the art, the specific meanings of the above terms in the embodiments of the present invention can be understood according to specific circumstances.
[0062] In one embodiment of the present invention, as Figure 1 shown, a differential image sensor with digital pixel storage is provided, including a pixel array and a plurality of acquisition circuits. The pixel array includes a plurality of unit pixels, and each acquisition circuit corresponds to at least one unit pixel. The acquisition circuit is also referred to as a pixel circuit throughout the specification. Among them, each of the unit pixels is usually organized into a two-dimensional grid with "rows" and "columns" to form the pixel array. Alternatively, each of the unit pixels is arranged in an irregular shape to form the pixel array.
[0063] Among them, each of the acquisition circuits includes at least one sensor circuit 100, analog-to-digital conversion circuit 200, digital storage circuit 300, digital comparison circuit 400, and digital output circuit 500.
[0064] Each of the sensor circuits 100 includes a photosensor, which is configured to generate a sensor signal VSIG according to a light signal illuminating at least one pixel corresponding to the photosensor. The photosensor can generate the sensor signal VSIG continuously or periodically.
[0065] The analog-to-digital conversion circuit 200 is configured to generate a current digital signal according to the sensor signal VSIG.
[0066] The digital storage circuit 300 is configured to store a previous digital signal. Herein, the previous digital signal is a digital signal generated according to a previous sensor signal VSIG. The previous sensor signal VSIG corresponds to the signal generated and stored in the digital storage circuit 300 during any previous sampling period. Alternatively, the previous digital signal can also be provided externally and stored. To ensure the timeliness of data storage and considering that the level of the digital signal does not degrade over time, by storing the previous digital signal, and the storage circuit of the previous digital signal can be physically implemented with a smaller volume and can be used more conveniently and efficiently, such as combination and comparison with other pixels or other signals.
[0067] The digital comparison circuit 400 is configured to compare the level of the current digital signal with the level of the previous digital signal and determine whether there is a changing level in the current digital signal. The digital output circuit 500 is configured to generate an event signal and output it when there is a changing level in the current digital signal.
[0068] In another embodiment of the present invention, the analog-to-digital conversion circuit is a single-slope analog-to-digital converter.
[0069] Among them, the analog-to-digital conversion circuit uses different storage ramps and comparison ramps for comparison to achieve analog-to-digital conversion, and the comparison between the storage ramp and the comparison ramp generates a difference function.
[0070] Among them, in another embodiment of the present invention, such as Figure 1As shown, the analog-to-digital conversion circuit 200 includes a comparator, and the comparator is used to compare the sensor signal VSIG with a scanning signal. The conversion from the analog signal (VSIG) to the digital signal is performed through the comparator and the scanning signal applied to the pixel array. According to the switching point of the comparator output, the digital representation is copied to the digital storage circuit 300.
[0071] Among them, the scanning signal can be an analog scanning input signal, or a continuous analog scanning input signal. Each analog scanning input signal provides a different slope of the ramp signal, and the slope of the ramp signal is the slope of the stored ramp.
[0072] By providing different slopes of the ramp signal, the comparison between the analog scanning input signals with different slopes of the ramp signal and the sensor signal VSIG is realized, thereby improving the accuracy of converting the sensor signal VSIG into a digital signal.
[0073] In another embodiment of the present invention, when the stored ramp and the comparison ramp are compared, a difference value between the two is generated each time of comparison. The difference value is a voltage difference, and the voltage differences are summarized to form a difference function, and the difference function is used to characterize the difference between the stored ramp and the comparison ramp.
[0074] When the slope of the stored ramp is set to be constant, if the slope of the comparison ramp is also constant, there is a specific voltage difference between the stored ramp and the comparison ramp, and the specific voltage difference is constant. This situation is applicable when the slope of the stored ramp is changed. When the slope of the comparison ramp is constant or changes, when the slope changes, the voltages of the stored ramp and the comparison ramp both change. At this time, there is a specific voltage difference between the stored ramp and the comparison ramp, and the specific voltage difference changes with the voltage changes of the stored ramp and the comparison ramp.
[0075] In another embodiment of the present invention, the stored ramp is generated from the digital signal pre-stored in the digital storage circuit. The pre-stored digital signal is generated from the VSIG signal at the previous moment or the previous time period, and is used to characterize the light intensity at the previous moment or the previous time period.
[0076] Then, the stored ramp is compared with the comparison ramp generated from the current VSIG signal at the current moment, so as to generate a digital signal when the light intensity signal changes.
[0077] In this way, when the stored ramp is from the previous moment, the slope of the stored ramp is constant. When the stored ramp is from the previous time period, the slope of the stored ramp changes. In this way, based on the digital signal at the backend, the current analog-to-digital signal conversion is regulated to improve the conversion efficiency and reduce the generation of redundant events at the same time.
[0078] In another embodiment of the present invention, the storage ramp is preset and the ramp slope is changed in real time. The change in the ramp slope is based on the difference value generated by the comparison between the previous moment and the comparison ramp. By changing the ramp slope, the difference value between the changed storage ramp and the comparison ramp is reduced, thereby realizing the change of the difference function.
[0079] In another embodiment of the present invention, the storage ramp and the comparison ramp are used according to the state of the pixel. Wherein, the change of the pixel state reverses the definitions of the storage ramp and the comparison ramp. That is, with the change of the pixel state, the comparison ramp at the current moment is defined as the storage ramp at the next moment, so as to realize the judgment of whether the light intensity changes between the current moment and the next moment.
[0080] If the digital code A is recorded during the storage ramp, the digital code B is read during the comparison ramp, and B≥A, it indicates that VSIG during the comparison is greater than VSIG. That is, through the difference between the ramps, the change of the VSIG signal between the current moment and the previous moment is characterized, and further the change of the light intensity of the external environment is characterized.
[0081] In another embodiment of the present invention, according to the state of the pixel, one storage ramp is compared with one or more comparison ramps.
[0082] Alternatively, multiple storage ramps are compared with one or more comparison ramps.
[0083] Wherein, comparing one storage ramp with one comparison ramp generates one difference function. When one storage ramp is compared with multiple comparison ramps, one difference function is generated respectively.
[0084] When multiple storage ramps are compared with one comparison ramp, one difference function is generated respectively.
[0085] When multiple storage ramps are compared with multiple comparison ramps, one difference function is generated respectively.
[0086] In another embodiment of the present invention, one storage ramp is compared with one or more comparison ramps, or multiple storage ramps are compared with one or more comparison ramps; wherein, comparing one storage ramp with one comparison ramp generates one difference function; and the comparison between the storage ramp and the comparison ramp is not affected by the pixel state.
[0087] In another embodiment of the present invention, a digital comparison based on the storage ramp and the comparison ramp is performed during the ramp, and the digital comparison value generated by the digital comparison is not stored.
[0088] Among them, the ramp device stores the existence time of the storage ramp and the comparison ramp. By only comparing and not storing the comparison value temporarily, it suppresses the signal change caused by the local light intensity change and reduces the generation of invalid events.
[0089] In another embodiment of the present invention, a digital comparison is performed between the storage ramp and the comparison ramp after the ramp period, and the digital comparison value generated by the digital comparison is stored.
[0090] The acquisition circuit can detect the light intensity that changes within a period of time. If the digital comparison circuit 400 detects a difference between the previously stored previous digital signal and the subsequent digital signal, and this difference meets a preset given standard, an event is generated, that is, an event signal is generated, and the fact of the change is reported as event information to the device at the output end, such as an image sensor.
[0091] In another embodiment of the present invention, one acquisition circuit corresponds to at least two unit pixels, that is, one acquisition circuit can collect signals from at least two unit pixels. Preferably, at least two unit pixels are adjacent to each other.
[0092] In another embodiment of the present invention, as Figure 1 shown, the sensor circuit 100 generates the sensor signal VSIG in response to a control signal, and the sensor signal VSIG changes its corresponding relationship with the light intensity based on the control of the control signal, and / or, the sensor circuit 100 generates the sensor signal VSIG in response to a control signal during operation, and the sensor signal VSIG changes its corresponding relationship with the light intensity based on the control of the control signal.
[0093] Among them, the control signal acts on the entire pixel array or local unit pixels in the pixel array. The operation period is the usage period of the differential image sensor with digital pixel storage.
[0094] In another embodiment of the present invention, the sensor signal VSIG generated by the sensor circuit 100 has any one of the following corresponding relationships with the light intensity:
[0095] The sensor signal VSIG is linearly related to the light intensity, or, the sensor signal VSIG is non-linearly related to the light intensity, where the non-linear relationship includes but is not limited to logarithmic change; or, the sensor signal VSIG has a combined relationship of non-linear and linear correlation with the light intensity; among them, the above corresponding relationships change in response to a control signal.
[0096] Among them, the sensor signal VSIG is linearly correlated with the light intensity, which means converting the optical illumination intensity signal into an analog electrical signal (VSIG) with a linear relationship. This conversion relationship is applicable to application environments with low light and little light change.
[0097] The sensor signal VSIG is non-linearly correlated with the light intensity, which means converting the optical illumination intensity signal into an analog electrical signal with a logarithmic relationship. This conversion relationship is advantageous in terms of the high dynamic range of the optical illumination signal because the output analog signal will not saturate over a wide range of illumination intensities, more truly reflecting the change of the optical illumination intensity.
[0098] The sensor signal VSIG is in a combined relationship of non-linear and linear correlation with the light intensity, which means converting the optical illumination intensity signal into an analog electrical signal with a combined logarithmic and linear relationship or a similar non-linear function relationship.
[0099] During actual operation, the specific conversion correspondence is selected or set according to actual needs.
[0100] Specifically, a signal source, such as a signal generation circuit, can be separately set to provide the control signal. Based on actual use, the control signal is a signal that changes from time to time. The change of the control signal comes from the global light intensity or the actual operation during operation. Based on the control signal, the conversion of the corresponding relationship between the sensor signal VSIG and the light intensity is realized to meet the data usage requirements in different scenarios.
[0101] Among them, a single or continuous analog scan input signal is used to provide at least one of the analog-to-digital conversion circuits 200. That is, a scan signal can scan one or more analog-to-digital conversion circuits 200 in one acquisition circuit, or can scan one or more analog-to-digital conversion circuits 200 in multiple acquisition circuits at the same time, thereby improving the analog-to-digital conversion efficiency and the data processing speed.
[0102] And / or, b) the analog-to-digital conversion circuit 200 is further configured to provide a digital code parallel to the scan signal to at least one pixel, and the digital code stored in the digital storage circuit 300 is the digital code value output after comparison by a comparator. The digital code is preferably a Gray code, which makes full use of the fact that the Gray code does not need to be synchronized with the digital storage, and only one bit changes at a time, and the codes on either side of the Gray code are valid, and the Gray code has fewer edges, reducing the power consumption during the data processing process.
[0103] In another embodiment of the present invention, the digital output circuit 500 is configured to generate and output an event signal when there is a changing level in the current digital signal and the changing level exceeds a preset specific threshold, where the specific threshold is set based on a fixed intensity change rate of the optical signal.
[0104] The optical signal, which is the signal emitted by an artificial light source, usually has a regularly varying intensity based on different voltages of the power supply. That is, due to the limitations of the structure and control of the artificial light source on the market, its intensity changes regularly. For example, the fixed intensity change of an incandescent lamp is 14%, that of a fluorescent lamp is 8%, and that of an LED is 9%. When the specific threshold value generated by the digital output circuit 500 and output is set to be less than the fixed intensity change of the artificial light source, such as 2%-3%, the modulation of artificial lighting is very likely to cause a large number of redundant events.
[0105] Therefore, in order to suppress or eliminate the redundant events caused by the fixed intensity change of the artificial light source, it is necessary to set the specific threshold value based on the fixed intensity change rate of the optical signal.
[0106] Specifically, when there is more than one optical signal, the specific threshold value is greater than the fixed intensity change rate corresponding to the optical signal, thus reducing the generation of redundant events.
[0107] When there are multiple optical signals and each optical signal has a different fixed intensity change rate, the specific threshold value is greater than the maximum fixed intensity change rate among the fixed intensity change rates of each optical signal, thereby ensuring that it is not affected by the fixed intensity change rates of all the optical signals themselves. This setting is applicable to the situation where the number of optical signals inherent in a known background environment is known, and it is necessary to shield the redundant events caused by all the optical signals inherent in the background.
[0108] For example, when conducting a relevant experiment, there are 3 kinds of optical signals inherent in the background environment of the experiment. In order to obtain the event change situation caused by the optical signals other than the 3 kinds of optical signals in the background environment, it is necessary to shield the redundant events caused by the 3 kinds of optical signals in the background environment during the experiment. Therefore, at this time, the specific threshold value is set to be greater than the maximum of the 3 fixed intensity change rates corresponding to the 3 kinds of optical signals in the background environment, which also meets the experimental requirements.
[0109] In this case, the fixed intensity change rate of the optical signal other than the 3 kinds of optical signals in the background environment is greater than the specific threshold value. The setting of the specific threshold value is generally slightly greater than the maximum of the 3 fixed intensity change rates corresponding to the 3 kinds of optical signals in the background environment, so as to ensure that the acquisition of events caused by the target optical signal is not affected on the premise of shielding the redundant events generated by the optical signals in the background.
[0110] When testing the differential image sensor with digital pixel storage and synchronous sampling,
[0111] In another embodiment of the present invention, the specific threshold may be preset or set in real time during operation according to the change of the optical signal.
[0112] In another embodiment of the present invention, the repetition rate of the scanning signal is preset and used to reduce or eliminate redundant events caused by the change of the light intensity of the optical signal illuminating the optical sensor. Specifically, the repetition rate of the scanning signal is the frequency at which the scanning signal is provided to the analog-to-digital conversion circuit 200.
[0113] Wherein, the repetition rate of the scanning signal is set based on at least one preset repetition rate, and the preset repetition rate matches the modulation frequency of the optical signal irradiating the optical sensor.
[0114] It should be understood that the repetition rate of the scanning signal is selected from one or more preset repetition rates, and each preset repetition rate corresponds to the light source modulation of the optical signal irradiating the optical sensor. It should be understood that when the fixed intensity change rate of the optical signal itself is certain, the number of redundant events generated within a period of time is certain. And within this period of time, if the scanning signal continuously scans and the repetition rate is always higher than the modulation frequency of the optical signal irradiating the optical sensor, then all the redundant events generated within this event segment will be acquired. Therefore, in order to reduce the number of redundant events, it is necessary to adjust the repetition rate of the scanning signal.
[0115] When there are multiple modulation frequencies of the optical signal irradiating the optical sensor, such as 50HZ, 100HZ, and 200HZ respectively, that is, at 50HZ, 100HZ, and 200HZ, within one cycle, the number of intensity changes of the corresponding light intensity is 100 times, 200 times, and 400 times respectively, then the number of generated redundant events is 100, 200, and 400 respectively. At this time, in order to reduce redundant events, the repetition rate of the scanning signal is set based on the repetition rates corresponding to 50HZ, 100HZ, and 200HZ. For example, it can be set that the repetition rate is less than the number of intensity changes of the light intensity, such as setting the repetition rate of the scanning signal to scan 25 times within one cycle, and one scan acquires one redundant event, and a total of 25 redundant events are acquired, thereby reducing the number of redundant events.
[0116] Preferably, the repetition rate of the scanning signal is a multiple of the modulation frequency of the optical signal irradiating the optical sensor.
[0117] In another embodiment of the present invention, the scanning signal is a linear ramp, or a non-linear ramp, and the non-linear ramp includes but is not limited to an exponential ramp. The scanning signal can be generated centrally. Considering that the light intensity mostly changes non-linearly, it is preferred to set the scanning signal as non-linear. Therefore, the scanning signal can be generated by the signal generating device on the device to enhance the sharing on the hardware circuit and save the volume required by the hardware circuit.
[0118] In another embodiment of the present invention, the scan signal changes during operation, and / or the period of the scan signal changes during operation, and / or the scan signal is interrupted at a specific time during operation, and the specific time is set or preset during operation. Among them, during operation, the scan signal of the linear ramp or non-linear ramp can be changed to match different sensor signals VSIG to achieve real-time matching and comparison.
[0119] Specifically, the scan signal is repeatedly swept out during operation according to a preset scan rule. During operation, the repetition of the scan signal can be interrupted or extended as needed to change the repetition rate of the scan.
[0120] In another embodiment of the present invention, the analog-to-digital conversion circuit 200 is a single-slope analog-to-digital converter.
[0121] Among them, the analog-to-digital conversion circuit 200 uses different storage ramps to compare with the comparison ramp to achieve analog-to-digital conversion, and the comparison between the storage ramp and the comparison ramp generates a difference function.
[0122] Among them, in another embodiment of the present invention, as Figure 1 shown, the analog-to-digital conversion circuit 200 includes a comparator, and the comparator is used to compare the sensor signal VSIG with a scan signal. The conversion from the analog signal (VSIG) to the digital signal is performed through the comparator and the scan signal applied to the pixel array. According to the switching point of the comparator output, the digital representation is copied to the digital storage circuit 300.
[0123] Among them, the scan signal can be an analog scan input signal or a continuous analog scan input signal. Among them, each analog scan input signal provides a different slope of the ramp signal, and the slope of the ramp signal is the slope of the storage ramp.
[0124] By providing different slopes of the ramp signal, the comparison between the analog scan input signals with different slopes of the ramp signal and the sensor signal VSIG is realized, thereby improving the accuracy of converting the sensor signal VSIG into a digital signal.
[0125] In another embodiment of the present invention, when the storage ramp and the comparison ramp are compared, a difference value between the two is generated for each comparison, and the difference value is a voltage difference. After the voltage differences are summarized, a difference function is formed, and the difference function is used to characterize the difference between the storage ramp and the comparison ramp.
[0126] When the slope of the storage ramp is set to be constant, if the slope of the comparison ramp is also constant, there is a specific voltage difference between the storage ramp and the comparison ramp, and the specific voltage difference is constant. This situation applies to
[0127] When the slope of the storage ramp is set to change, when the slope of the comparison ramp is constant or changing, when the slope changes, the electrical levels of the storage ramp and the comparison ramp both change. At this time, there is a specific voltage difference between the storage ramp and the comparison ramp, and the specific voltage difference changes with the level changes of the storage ramp and the comparison ramp.
[0128] In another embodiment of the present invention, the storage ramp is generated from a digital signal pre-stored in the digital storage circuit 300. The pre-stored digital signal is generated by the VSIG signal at the previous moment or in the previous time period, and is used to characterize the light intensity at the previous moment or in the previous time period.
[0129] Next, the storage ramp is compared with the comparison ramp generated from the current VSIG signal at the current moment, so as to generate a digital signal when the light intensity signal changes.
[0130] In this way, when the storage ramp is from the previous moment, the slope of the storage ramp is constant. When the storage ramp is from the previous time period, the slope of the storage ramp is changing. In this way, based on the digital signal at the backend, the current analog-to-digital signal conversion is regulated to improve the conversion efficiency and reduce the generation of redundant events at the same time.
[0131] In another embodiment of the present invention, the storage ramp is pre-set and the slope of the ramp is changed in real time. The change of the slope of the ramp is based on the difference value generated by the comparison between the previous moment and the comparison ramp. By changing the slope of the ramp, the difference value between the changed storage ramp and the comparison ramp is reduced, and then the difference function is changed.
[0132] In another embodiment of the present invention, the storage ramp and the comparison ramp are used according to the state of the pixel. Wherein, the change of the state of the pixel reverses the definitions of the storage ramp and the comparison ramp. That is, with the change of the pixel state, the comparison ramp at the current moment will be defined as the storage ramp at the next moment, so as to judge whether the light intensity changes at the current moment and the next moment.
[0133] If the digital code A is recorded during the storage ramp and the digital code B is read during the comparison ramp, and B≥A, it means that the VSIG during the comparison is greater than the VSIG, that is, through the difference between the ramps, the change of the VSIG signal at the current moment and the previous moment is characterized, and then the change of the light intensity of the external environment is characterized.
[0134] In another embodiment of the present invention, according to the state of the pixel, a storage ramp is compared with one or more comparison ramps.
[0135] Alternatively, multiple storage ramps are compared with one or more comparison ramps.
[0136] Among them, comparing one storage ramp with one comparison ramp generates a difference function. When one storage ramp is compared with multiple comparison ramps, a difference function is generated respectively.
[0137] When multiple storage ramps are compared with one comparison ramp, a difference function is generated respectively.
[0138] When multiple storage ramps are compared with multiple comparison ramps, a difference function is generated respectively.
[0139] In another embodiment of the present invention, one storage ramp is compared with one or more comparison ramps, or multiple storage ramps are compared with one or more comparison ramps; among them, comparing one storage ramp with one comparison ramp generates a difference function; and the comparison between the storage ramp and the comparison ramp is not affected by the pixel state.
[0140] In another embodiment of the present invention, during the ramp, a digital comparison is performed based on the storage ramp and the comparison ramp, and the digital comparison value generated by the digital comparison is not stored.
[0141] Among them, the ramp device is the time when the storage ramp and the comparison ramp exist. By only comparing and not storing the comparison value temporarily, the signal change caused by the local light intensity change is suppressed, and the generation of invalid events is reduced.
[0142] In another embodiment of the present invention, a digital comparison is performed based on the storage ramp and the comparison ramp after the ramp period, and the digital comparison value generated by the digital comparison is stored.
[0143] In another embodiment of the present invention, as Figure 1 shown, the differential image sensor with digital pixel storage further includes at least one reference pixel, and the reference pixel is used to define the ramp signal. The reference pixel is preset or automatically set in real time during operation and is associated with the sensor signal VSIG. When a specific numerical representation or numerical range representation of a sensor signal VSIG is obtained, the reference pixel can be set, and the reference pixel is used to define the ramp signal to achieve more accurate and non-redundant comparison, so as to more efficiently promote subsequent data generation.
[0144] In another embodiment of the present invention, the reference pixel is disposed outside the pixel array.
[0145] In another embodiment of the present invention, as Figure 1As shown, the digital comparison circuit 400 compares the level with the previous digital signal during the scanning of the analog signal; alternatively, the digital comparison circuit 400 compares the level with the previous digital signal after the scanning of the analog signal.
[0146] When the digital comparison circuit 400 compares the level with the previous digital signal during the scanning of the analog signal, it is not necessary to store the A / D output value, and only the comparison result needs to be stored.
[0147] During the comparison after the scanning of the analog signal, an order, such as bitwise, can be used.
[0148] In another embodiment of the present invention, the digital comparison circuit 400 uses dynamic logic to compare levels, or the digital comparison circuit 400 uses static logic to compare levels.
[0149] Among them, when comparison is required in a low-power state, static logic is selected to compare levels. When high comparison speed is required and the output result needs to be maintained for a long time, dynamic logic is selected to compare levels.
[0150] In another embodiment of the present invention, feedback from the result of the previous comparison is utilized to perform digital comparison, that is, the comparison between the next moment and the previous moment, which is beneficial to suppressing noise and reducing the generation of false events.
[0151] In another embodiment of the present invention, both the comparison of digital signals and the output of event signals need to have specific differences to be realized, thereby reducing the number of generated times and improving the resolution of time occurrence. Among them, the level of the signal, the operation mode, the level of adjacent pixels, the previous level of the pixel, the time when the pixel was previously generated, and the events generated by adjacent pixels will all have the specific differences.
[0152] In another embodiment of the present invention, the digital output circuit 500 is used to output the output signal according to the comparison result of the digital comparison circuit 400 in adjacent pixels, or the digital output circuit 500 is used to generate an output signal according to a function in a fixed configuration of adjacent pixels or a function in a configuration that changes during operation, where the function includes but is not limited to an average function.
[0153] In another embodiment of the present invention, the digital output circuit 500 is used to generate an event signal according to the output of adjacent pixels, or the output circuit is used to generate an event signal according to the level stored in adjacent pixels, or the output circuit is used to generate an event signal according to multiple pre-stored stored values.
[0154] In another embodiment of the present invention, asFigure 1 As shown, the digital output circuit 500 is used to generate an event signal indicating the direction of the level change, and / or, the digital output circuit 500 is applied to generate an event signal indicating only one change direction of one changed level, and / or, the digital output circuit 500 is used to generate an event signal indicating the amplitude of the changed level, and / or, the digital output circuit 500 is used to generate the light intensity before and / or after the change of the changed level.
[0155] Among them, indicating the amplitude of the changed level is the intensity of the level change within a unit pixel. The event signal includes the level change direction and the level change intensity of a unit pixel or a pixel set, and the pixel set is formed by a plurality of unit pixels.
[0156] In another embodiment of the present invention, the generation of the event signal of one acquisition circuit depends on the event signal of another adjacent acquisition circuit, thereby filtering events to reduce the number of false events. Or, the generation of the event signal of one acquisition circuit depends on the digital levels stored in another adjacent acquisition circuit, thereby filtering events to provide higher sensitivity near the edge.
[0157] In another embodiment of the present invention, the generation of the event signal of one acquisition circuit depends on a plurality of digital signals stored in the digital storage circuit 300 in the acquisition circuit.
[0158] In another embodiment of the present invention, when the output of the event signal is a single event bit, such as the up event, it characterizes an increased light intensity. When the output of the event signal is two event bits, such as up and down, the event output can indicate whether the light intensity or the pixel signal VSIG is greater than or less than the stored light intensity level or the stored VSIG. The event output also includes the change amplitude of the digital signal, and based on this change amplitude, the image can be perfectly reconstructed from the event information, thereby obtaining the currently detected image.
[0159] In another embodiment of the present invention, the level change intensity of a unit pixel or a pixel set is characterized numerically on a specific icon.
[0160] Specifically, the specific icon includes but is not limited to a bar chart or a line chart, and numbers representing the level change intensity are attached to the bar chart or the line chart. In this way, the level change intensity is characterized in the form of a combination of numbers and icons.
[0161] In another embodiment of the present invention, the level change intensity of a unit pixel or a pixel set is characterized by the number of repeated transmissions of the unit pixel or the pixel set within a unit time, and the number of repeated transmissions is controlled by numbers to avoid data loss.
[0162] Conventional cameras of dynamic vision sensors, the analog implementation of which includes analog signals that are pre-stored and represent the previous pixel illumination intensity. This generally requires sampling the analog signal during a refresh pulse using a sampling and signal holding structure circuit with a capacitor for storage.
[0163] However, during the refresh pulse, any change in the image intensity is lost, such that the image change is not fully reflected in the output stream, resulting in information loss.
[0164] In the present invention, the event signal output through the digital output circuit includes the direction and intensity of the level change of a unit pixel or a pixel set, that is, the direction and intensity of the level change are packed together to avoid data loss and at the same time no redundant events are generated.
[0165] On the other hand, the analog sampling stage based on capacitance in the prior art is eliminated, ensuring that no information is lost during this stage.
[0166] Moreover, if the data bandwidth limitation means that the event signal cannot be output with normal latency, the previous reference and the previously stored direction and intensity of the level change are still valid. Once the bandwidth limitation is lifted and the event signal can be released, all and complete information can be output.
[0167] In another embodiment of the present invention, the direction and intensity of the level change are encoded at preset coding statistical time intervals, an intensity change code is generated, and the intensity change code is stored. That is, the update of the digital storage level is limited to one code in the event, ensuring data compressibility and at the same time ensuring the storage and use of the direction and intensity of the level change, greatly improving the data processing efficiency.
[0168] In another embodiment of the present invention, as Figure 1 shown, the digital storage circuit 300 is configured to provide a previously stored digital signal at the output line of the pixel array, and / or, the digital storage circuit 300 is configured to selectively provide a previously stored digital signal for a unit pixel having an event output on the output line of the pixel array, and / or, the digital storage circuit 300 is configured to provide a previously stored digital signal at the output line using a time column line, and / or, the digital storage circuit 300 is configured to write the previously stored digital signal into a unit pixel, and / or, the digital storage circuit 300 is configured to write a data stream into the previously stored digital signal; the digital storage circuit 300 is configured to write a data stream as an event stream into the previously stored digital signal.
[0169] In another embodiment of the present invention, the stored digital levels can be written into the pixel arrangement as a reference for comparison. And the data stream can be written into the stored digital levels to intentionally provide a time-related reference for event generation. Among them, the stored digital levels are the previous digital signals.
[0170] In another embodiment, the data stream is typically generated by a sensor.
[0171] The output line provided by the digital storage circuit 300 is at least one and is provided to at least one digital output circuit 500 so that one digital output circuit 500 or multiple digital output circuits 500 can share.
[0172] The previous digital signal stored in the digital storage circuit 300 can be written by an external pixel array, or the signal output at the previous moment can be written into the stored previous digital signal, thereby characterizing the change process of the signal. For example, when the digital signal output at time t1 is p, then at the next time t2, time t1 is the previous moment, and the output at time t1 is p, then p is the previous digital signal for time t2. This previous digital signal is used as a reference and is only output at time t2 when compared with the reference, that is, when the signal changes compared with time t1, and then an event signal is output. That is, a signal is only output when there is a change, reducing the generation of redundant data.
[0173] In another embodiment of the present invention, the digital storage values from the target area are selectively read, that is, through random access.
[0174] In another embodiment of the present invention, a sampling rate can also be set. The sampling rate is the frequency of collecting event signal generation. The sampling rate can be changed from time to time during operation based on electrical configurations, such as hardware circuits. Different sampling rates also determine different power consumptions and event generation rates. When there is no event signal for a long time or during non-use time, a very low power consumption mode can be achieved by reducing the sampling rate, or the power consumption can be reduced by completely interrupting the sampling for a period of time.
[0175] In another embodiment of the present invention, the sensor circuit 100 receives feedback corresponding to the digital levels stored in the digital storage circuit 300 or the digital levels of adjacent pixels stored in the digital storage circuit 300, and the sensor circuit 100 generates a sensor signal VSIG based on this feedback, and / or the analog-to-digital conversion circuit 200 receives feedback from the levels of the stored previous digital signals or the levels of the previous digital signals stored in adjacent unit pixels, and adjusts the currently output digital signal according to this feedback. Through the setting of feedback, the generated sensor signal VSIG is made more accurate.
[0176] The output modes of the event signal include a continuous output mode and an intermittent output mode. The output mode of the event signal is switched between the continuous output mode and the intermittent output mode in response to an interrupt control signal, which is generated by the digital output circuit 500. By setting the continuous output mode, it is applicable to the situation where the event signal is generated at a high frequency, that is, in a high-power consumption state. The intermittent output mode is applicable to a low-power consumption state, that is, when the frequency of the event signal generation is not high, or it can be understood that the event signal is not generated for a long time.
[0177] When in the intermittent output mode, the event signal is intermittently output at a preset specific time interval. That is, the event signal is first stored and lasts for a period of time, and after continuously storing for a period of time, the same output event signal is output. Among them, the specific time interval can be set by itself, such as set to 5 minutes, 10 minutes, even half an hour, or 6 hours, etc. Taking 5 minutes as an example, the event signal is output once every 5 minutes.
[0178] In this way, by utilizing the intermittent output and the characteristic that digital signals are easy to store in the digital output circuit 500 without data loss, it ensures low power consumption while ensuring the lossless output of events.
[0179] When in the continuous output mode, the event signal is immediately output when a changing level of the current digital signal is detected.
[0180] In another embodiment of the present invention, when the digital output circuit 500 detects a changing level of the current digital signal within a first specific time period and the frequency of the level change does not exceed a preset frequency, the digital output circuit 500 controls the output mode of the event signal to be the intermittent output mode. The first specific time period is set as needed, such as set to 1 minute. The preset frequency is preset. When the frequency of the level change does not exceed the preset frequency, it indicates that the generation frequency of the event signal is relatively low at this time. Therefore, at this time, it can be set to the low-power consumption mode, that is, the intermittent output mode.
[0181] In another embodiment of the present invention, when the digital output circuit 500 detects a changing level of the current digital signal within a first specific time period and the frequency of the level change exceeds the preset frequency, at this time, the generation frequency of the event signal is relatively high, which is a high-power consumption mode. At this time, the digital output circuit 500 controls the output mode of the event signal to be the continuous output mode.
[0182] In another embodiment of the present invention, when the digital storage circuit 300 does not acquire a digital signal generated based on a previous sensor signal VSIG within a second specific time period, it indicates that no new digital signal is generated during the second specific time period. Therefore, it shows that the external environment has no change, that is, no new event signal will be generated at this time. It can be determined that this is the low-power mode at this time. Thus, a first instruction signal is generated and sent to the digital output circuit 500, and the digital output circuit 500 controls the output mode of the event signal to be an intermittent output mode according to the first instruction signal.
[0183] Further, when the digital storage circuit 300 acquires at least one digital signal generated based on a previous sensor signal VSIG within a second specific time period, it indicates that the external environment is continuously changing. Therefore, a second instruction signal is generated and sent to the digital output circuit 500, and the digital output circuit 500 controls the output mode of the event signal to be a continuous output mode according to the second instruction signal.
[0184] In addition, the storage of digital signals does not degrade over time, and information can be retained indefinitely without losing information or requiring image frame refreshing. In some applications, such as monitoring, in different triggering environments, the image usually does not change for a long time. By setting the switching of the event output mode, the observation rate can be greatly reduced and power can be saved.
[0185] In another embodiment of the present invention, the digital part of the acquisition circuit provides a digital control signal to the sensor circuit 100, and the digital control signal is used to modulate the analog function of the sensor circuit 100. Modulating the analog function of the differential image sensor with digital pixel storage based on the digital control signal makes use of the advantage that the digital control signal has strong interference suppression ability.
[0186] The analog function of the sensor circuit 100 is the function of generating the sensor signal, which specifically includes at least the frequency of generating the sensor signal VSIG, the condition setting of generating the sensor signal VSIG, and the interruption or stop of generating the sensor signal VSIG.
[0187] The digital part of the acquisition circuit is the digital storage circuit 300, the digital comparison circuit 400, and the digital output circuit 500. That is, it can be set that the digital storage circuit 300 provides the digital signal stored therein as the digital control signal to the sensor circuit 100.
[0188] Alternatively, it can be set that the digital value generated after comparison in the digital comparison circuit 400 is used as the digital control signal and provided to the sensor circuit 100.
[0189] Alternatively, the digital value included in the event signal generated by the digital output circuit 500 may be set as the digital control signal and provided to the sensor circuit 100.
[0190] In another embodiment of the present invention, the digital control signal in the acquisition circuit corresponding to a unit pixel modulates the analog function of the sensor circuit 100 corresponding to the unit pixel to provide a hysteresis function within a unit pixel. That is, for a unit pixel, the digital control signal within the unit pixel only acts within the unit pixel.
[0191] The hysteresis function is the time when the sensor signal VSIG is output to the next stage, that is, output to the analog-to-digital conversion circuit 200. That is, the digital storage circuit 300, the digital comparison circuit 400, and the digital output circuit 500 modulate the analog function of the sensor circuit 100 according to the digital values stored or generated therein, thereby realizing the hysteresis output of the output signal of the sensor circuit 100, and then the signal hysteretically output to the analog-to-digital conversion circuit 200, so as to ensure that the data processing amounts of the digital storage circuit 300, the digital comparison circuit 400, and the digital output circuit 500 will not be overloaded, and thus ensure stable data processing efficiency.
[0192] Furthermore, compared with the signal loss problem that is likely to occur in the prior art when modulating the sensor circuit 100 with an analog signal, in this application, lossless modulation is achieved through the digital control signal, avoiding signal and event loss.
[0193] In another embodiment of the present invention, the digital control signal in the acquisition circuit corresponding to a unit pixel modulates the analog function of the sensor circuit 100 in other unit pixels outside the unit pixel to provide a hysteresis function spanning a unit pixel. That is, for a unit pixel, the digital control signal within the unit pixel can act on other unit pixels outside the unit pixel, such as adjacent unit pixels, thereby realizing the modulation of the analog functions in multiple unit pixels by one digital control signal. Compared with the prior art where multiple analog circuits need to be set up for analog modulation respectively, on the one hand, the modulation efficiency is improved, and on the other hand, there is no need to set up a hardware circuit to provide an analog modulation signal, reducing the overall volume of the differential image sensor with digital pixel storage.
[0194] In another embodiment of the present invention, the sensor circuit 100 is used to provide an analog representation of the sensor signal VSIG, and / or, the differential image sensor with digital pixel storage is composed of multiple semiconductor layers, and each of the semiconductor layers has different optimized functions.
[0195] Specifically, the semiconductor process type of each layer is optimized for the function of that layer. For example, performance is improved, specifically such as improving heat dissipation. Or, following the requirements of device size and device cost, the silicon area of the semiconductor layer is reduced to meet the actual usage requirements, as long as the physical structure of the changed semiconductor layer can improve the accuracy and efficiency of the light intensity change, and reduce the electrical interference between the control signal line and the photoelectric sensor circuit 100.
[0196] In another embodiment of the present invention, each of the acquisition circuits may be connected to a common or multiple common event output lines. A group of acquisition circuits may share any one of the digital output circuit 500, the digital comparison circuit 400, the digital storage circuit 300, and the analog-to-digital conversion circuit 200.
[0197] The above are only the preferred embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent replacements, and improvements made within the spirit and principles of the present invention shall be included in the protection scope of the present invention.
Claims
1. A differential image sensor with digital pixel storage, characterized in that, It includes a pixel array and a plurality of acquisition circuits. The pixel array includes a plurality of unit pixels, and each of the acquisition circuits corresponds to at least one unit pixel. Among them, each of the acquisition circuits includes: At least one sensor circuit, and each of the sensor circuits includes an optical sensor. The optical sensor is used to generate a sensor signal VSIG according to the optical signal illuminating at least one pixel corresponding to the optical sensor. At least one analog-to-digital conversion circuit, and the analog-to-digital conversion circuit is used to generate a current digital signal according to the sensor signal VSIG. At least one digital storage circuit, and the digital storage circuit is used to store a previous digital signal, where the previous digital signal is a digital signal generated according to a previous sensor signal VSIG. At least one digital comparison circuit, and the digital comparison circuit is used to compare the level of the current digital signal with the level of the previous digital signal and determine whether there is a changing level in the current digital signal. At least one digital output circuit, and the digital output circuit is used to generate an event signal and output it when there is a changing level in the current digital signal. Among them, a digital control signal is provided by the digital part of the acquisition circuit and acts on the sensor circuit. The digital control signal is used to modulate the analog function of the sensor circuit. The digital part of the acquisition circuit includes the digital storage circuit, the digital comparison circuit, and the digital output circuit. The analog function of the sensor circuit is the function of generating the sensor signal VSIG. The digital control signal in the acquisition circuit corresponding to a unit pixel modulates the analog function of the sensor circuit corresponding to the unit pixel to provide a hysteresis function within a unit pixel. Alternatively, the digital control signal in the acquisition circuit corresponding to a unit pixel modulates the analog function of the sensor circuit in other unit pixels outside the unit pixel to provide a hysteresis function spanning a unit pixel.
2. The differential image sensor with digital pixel storage according to claim 1, characterized in that, The digital control signal is provided by the digital storage circuit.
3. The differential image sensor with digital pixel storage according to claim 1, characterized in that, The digital control signal is provided by the digital comparison circuit.
4. The differential image sensor with digital pixel storage according to claim 1, characterized in that, The digital control signal is provided by the digital output circuit.
5. The differential image sensor with digital pixel storage according to claim 1, characterized in that, The intensity of the level change of a unit pixel or a pixel set is characterized numerically on the icon.
6. The differential image sensor with digital pixel storage according to claim 5, characterized in that, The icon includes, but is not limited to, a bar chart or a line chart, and the number characterizing the intensity of the level change is added to the bar chart or the line chart.
7. The differential image sensor with digital pixel storage according to claim 5, characterized in that, The intensity of the level change of a unit pixel or a pixel set is characterized by the number of repeated transmissions of the unit pixel or the pixel set per unit time, and the number of repeated transmissions is controlled by a number to avoid data loss.
8. The differential image sensor with digital pixel storage according to claim 5, characterized in that, The direction and intensity of the level change are encoded at every preset coding statistical time to generate an intensity change code, and the intensity change code is stored.
Citation Information
Patent Citations
Event sensors with flicker analysis circuitry
US20210067679A1