Event Camera Pixel Processing With Leaky Integrators
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing event-based cameras suffer from noise and high complexity, necessitating a system with reduced noise and complexity while maintaining performance and efficiency.
Innovation Solution
A data processing system that utilizes leaky integrators with different time constants to process pixel data, generating differential signals indicative of contrast, and incorporates a threshold unit to detect events, reducing noise and complexity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If event-based cameras use high amplification to improve sensitivity in low-light conditions, then noise increases significantly
Solution Approach 1:
The patent segments the pixel array into multiple regions with different amplification factors. Some regions use high amplification for sensitivity while others use low amplification to avoid noise, allowing the system to obtain both high-sensitivity and low-noise data simultaneously through different spatial segments.
Solution Approach 2:
Different regions of the sensor are assigned different amplification characteristics based on local requirements. The patent applies local quality by making amplification factors spatially varying rather than uniform, enabling each region to operate optimally for its specific function.
2Object-generated harmful factors
If event-based cameras implement dynamic threshold adjustment to reduce noise, then device complexity increases
Solution Approach 1:
The patent changes the amplification parameter spatially across different regions of the sensor array. By varying the amplification factor parameter in different spatial locations, the system achieves noise reduction without requiring complex dynamic threshold adjustment mechanisms.
3Measurement precision
If conventional image processing operations are performed on all pixels, then processing time increases
Solution Approach 1:
The patent extracts only the essential differential information needed for contrast detection rather than performing complete image processing operations. By taking out only the necessary contrast-related data from the pixel signals, the system achieves fast processing while maintaining image quality.
Solution Approach 2:
Instead of performing full image processing on all pixels, the patent applies partial action by processing only the differential contrast information. This selective processing approach reduces computation time while still achieving the necessary image quality for the application.
Data Source
AI summary
The disclosure relates to a data processing system, configured to receive pixel data, comprising central pixel data and neighboring pixel data, from each image of a sequence of images captured by an imaging device as system input and configured to have a system output, comprising: a network comprising: a plurality of input nodes, each input node configured to receive pixel data from a respective pixel as input, each input node comprising an input node leaky integrator, LI, having a first time constant and a weight for the input, and each input node being configured to produce an input node output by applying the input node LI and a respective weight to the input; and an output node, comprising an output node weight and a multiple input LI having a second time constant, wherein the output node is configured to receive each of the input node outputs, wherein the output node is configured to receive pixel data from the central pixel, wherein the output node is configured to combine the pixel data from the central pixel with the output node weight to produce weighted central pixel data and wherein the output node is configured to apply the multiple input LI to the weighted central pixel data and to each of the node outputs and wherein the output node is configured to produce the system output as a combination of the weighted central pixel data and each of the node outputs; and wherein the second time constant is smaller than the first time constant, and wherein the system output is indicative of a contrast.