Computational Pixel Imagers for Event-Based Video Compression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional imaging arrays, such as CCDs and CMOS devices, lack advanced in-pixel data-processing capabilities, limiting their ability to efficiently handle and process detected signals in real-time.
Innovation Solution
The development of computational pixel imaging arrays that integrate circuits within each pixel to digitize detected signals and perform advanced signal-processing functions, including event-based imaging and inter-frame video compression.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional imaging arrays (CCD/CMOS) are used, then device simplicity is maintained, but signal processing capability and real-time handling efficiency are limited
Solution Approach 1:
The patent merges the detector element with digital signal processing circuitry within each pixel of the imaging array. Each pixel includes a photodetector, analog-to-digital converter, and processing logic that can independently process detected signals, perform event-based imaging, and execute inter-frame video compression algorithms, eliminating the need for separate processing units
Solution Approach 2:
The imaging array is designed with multi-functional pixels that can simultaneously perform detection, analog-to-digital conversion, event-based imaging, and video compression. The same hardware infrastructure supports multiple imaging modes and processing tasks, making the device adaptable to various applications without requiring additional specialized components
2Productivity
If advanced in-pixel data processing is implemented, then real-time signal processing efficiency is improved, but manufacturing complexity increases
Solution Approach 1:
The imaging array is segmented into independent functional blocks at the pixel level, with each pixel containing its own detector, converter, and processing logic. This segmentation allows for modular manufacturing approaches and facilitates the integration of complex functions within each pixel while maintaining overall system manufacturability
Solution Approach 2:
The patent replaces mechanical or external signal processing systems with integrated digital circuitry within each pixel. Analog signal processing is substituted with digital processing, and external processing hardware is replaced by in-pixel processing logic, simplifying the overall system architecture while enabling real-time processing
3Use of energy by moving object
If event-based imaging with in-pixel processing is used, then power consumption is reduced, but device complexity increases
Solution Approach 1:
The patent extracts and processes only the relevant signal information at the pixel level, identifying and transmitting only events or changes rather than continuously processing all detected signals. This selective processing approach reduces power consumption by eliminating redundant computations while maintaining the necessary processing functionality
Solution Approach 2:
The imaging array employs periodic sampling and event-triggered processing rather than continuous processing. The inter-frame video compression utilizes periodic reference frames and delta frame updates, allowing the system to reduce processing activity during stable periods while maintaining responsiveness to changes, thereby reducing overall power consumption
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enables efficient real-time signal processing, improved dynamic range, and reduced power consumption, while also allowing for event-based imaging and high-speed video compression.
Implementation Method 1
a detector configured to generate an analog signal when exposed to radiation
Data Source
AI summary
A computational pixel imaging device that includes an array of pixel integrated circuits for event-based detection and imaging. Each pixel may include a digital counter that accumulates a digital number, which indicates whether a change is detected by the pixel. The counter may count in one direction for a portion of an exposure and count in an opposite direction for another portion of the exposure. The imaging device may be configured to collect and transmit key frames at a lower rate, and collect and transmit delta or event frames at a higher rate. The key frames may include a full image of a scene, captured by the pixel array. The delta frames may include sparse data, captured by pixels that have detected meaningful changes in received light intensity. High speed, low transmission bandwidth motion image video can be reconstructed using the key frames and the delta frames.