Hybrid Imaging Sensor Pixel Layout for High-Speed Event Capture
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional image sensors lack the capability to provide ultra-high frame rates and ultra-high speed capture, which are essential for applications like machine vision, gaming, and artificial intelligence sensing, while maintaining image quality.
Innovation Solution
A hybrid image sensor system with a pixel circuit that includes a first subset of pixels for conventional image/video capture and a second subset of pixels for event-driven sensing, arranged with high sampling point distribution to enhance contrast and modulation transfer function.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If conventional image sensors are used for image capture, then image quality is maintained, but ultra-high frame rates and ultra-high speed capture capability are lacking
Solution Approach 1:
The pixel array is divided into two distinct subsets: a first subset of pixels configured for conventional image/video capture and a second subset of pixels configured for event-driven sensing. This segmentation allows each subset to be optimized for its specific function, enabling the sensor to achieve ultra-high frame rates for event detection while maintaining image quality for conventional capture modes.
2Speed
If a hybrid pixel configuration is implemented, then ultra-high speed event detection is achieved, but device complexity increases
Solution Approach 1:
Different regions of the pixel array are assigned different functional characteristics. The first subset of pixels is optimized for conventional image capture with full color filter arrays, while the second subset is optimized for event-driven sensing with simplified structures. This local differentiation enables ultra-high speed event detection in specific regions without requiring the entire sensor to operate at that speed, thereby managing complexity.
3Measurement precision
If high sampling point distribution is implemented, then contrast and modulation transfer function are improved, but manufacturing precision requirements increase
Solution Approach 1:
The patent employs asymmetric arrangements of the first and second subset pixels within the pixel array, creating high sampling point distribution patterns that are deliberately non-uniform. This asymmetric design improves contrast and modulation transfer function by optimizing spatial sampling characteristics, while the regularity of the underlying pixel grid structure maintains compatibility with standard manufacturing processes.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The hybrid image sensor system simultaneously achieves great image and video capture capabilities, ultra-high frame rates, and ultra-high speed event detection, while maintaining improved contrast and modulation transfer function compared to conventional sensors.
Implementation Method 1
The image sensor includes an array of pixels having photosensitive elements (e.g., photodiodes) that absorb a portion of the incident image light and generate image charge upon absorption of the image light
Data Source
AI summary
A pixel circuit includes a pixel array and a color filter. The pixel array includes a plurality of pixels each comprising two photodiodes, a floating diffusion coupled between the two photodiodes, and two transfer transistor coupled between the two photodiodes and the floating diffusion. The color filter array includes a plurality of color filters each having one of a plurality of colors and disposed over at least one of the pixels. Each pixel is coupled to a first readout circuit. The pixels include a second subset of the pixels coupled to a second readout circuit and a first subset of the pixels not coupled to the second readout circuit. Each pair of pixels arranged in two adjacent rows includes a first pixel included in the second subset of the pixels and a second pixel included in the first subset of the pixels and disposed underneath one of the color filters.