Dual Sensor Video Capture Subsampling Reconstruction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current high-speed imaging technologies face limitations in achieving high frame rates at full resolution due to pixel readout rates, resulting in lower sensitivity and noisier images, and dual color-monochrome sensors often lead to differing image characteristics with greater resolution loss in color sensors.
Innovation Solution
A dual sensor mechanism using a monochrome sensor and a Bayer sensor to capture sub-sampled frames, with a reconstruction unit generating high-resolution monochrome frames and high-speed high-resolution color frames through flexible sub-sampled readout mechanisms, allowing for improved light capture and noise reduction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If high frame rate imaging is used, then speed of capturing video is improved, but image quality deteriorates due to light-starved conditions and lower sensitivity
Solution Approach 1:
The imaging system is segmented into two separate sensors: a monochrome sensor for capturing luminance information and a color sensor for capturing chrominance information. This segmentation allows each sensor to be optimized for its specific function, enabling high frame rate capture while maintaining image quality through specialized processing of each sensor type's data
Solution Approach 2:
The system transitions from temporal dimension alone (high frame rate) to combining spatial and spectral dimensions. By capturing monochrome and color data separately and processing them through different reconstruction algorithms, the system achieves high frame rates without sacrificing image quality, effectively adding a spectral dimension to the problem solution
2Manufacturing precision
If full resolution capture is used, then manufacturing precision is improved, but productivity deteriorates due to pixel readout rate limitations
Solution Approach 1:
The system uses sub-sampled readout for the color sensor, capturing only essential chrominance information at reduced resolution, while the monochrome sensor captures full luminance detail. This partial action approach allows the color data to be captured at lower rates while maintaining overall image quality through intelligent reconstruction, thereby increasing frame rate without sacrificing perceived resolution
Solution Approach 2:
Different quality levels are applied to different components of the image: full resolution for luminance (monochrome) data and reduced resolution for chrominance (color) data. This local quality differentiation allows the system to prioritize human-perceived important information (luminance) while reducing the burden on the readout system, enabling higher frame rates
3Measurement precision
If dual color-monochrome sensors are used, then image quality is improved, but device complexity increases
Solution Approach 1:
The system merges the data processing pipelines of the monochrome and color sensors at the reconstruction stage. By combining the high-quality luminance data from the monochrome sensor with the chrominance data from the color sensor, the system achieves superior image quality while managing complexity through integrated processing rather than separate independent systems
4Productivity
If sub-sampled readout is used, then productivity is improved, but manufacturing precision deteriorates due to resolution loss
Solution Approach 1:
The monochrome sensor acts as an intermediary that captures full-resolution luminance information that is then used to guide the reconstruction of sub-sampled color data. This intermediary high-quality monochrome data serves as a template that fills in the gaps from the sparsely sampled color sensor, effectively recovering full resolution without requiring full readout from the color sensor
Data Source
AI summary
A method for generating video data using an imaging device is provided. The method includes capturing, by a first sensor of the imaging device, a first set of sub-sampled monochrome frames, capturing, by a second sensor of the imaging device, a second set of sub-sampled color frames, reconstructing one or more high resolution monochrome frames using the first set of sub-sampled monochrome frames, and generating one or more high speed high resolution color frames based on the second set of sub-sampled color frames and the reconstructed one or more high resolution monochrome frames.