Imaging Device Pixel Array Frame Rate Conversion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional imaging devices face difficulties in efficiently converting the frame rate of moving image data, especially when the data amount is large or the subject is actively moving, leading to inaccurate interpolation and increased processing requirements.
Innovation Solution
The imaging device employs a pixel array unit divided into regions, with a scanning circuit that controls exposure of partial regions to generate first and second frames, using quadtree division and analog-digital converters for efficient data processing, and an image processing unit that interpolates and maps pixel data based on motion data to enhance frame rate conversion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If frame interpolation is used to increase frame rate, then frame rate is improved, but processing amount becomes excessively large and accuracy decreases for large data amounts or active motion
Solution Approach 1:
The pixel array is divided into multiple divided regions (e.g., rectangular areas), with each region having its own ADC. This segmentation allows parallel processing of pixel data from different regions, increasing the overall frame rate without proportionally increasing the processing burden on each converter.
Solution Approach 2:
The scanning circuit performs preliminary sorting of pixel data based on exposure timing before the data reaches the ADC. By pre-organizing the data in temporal order, the subsequent frame rate conversion and interpolation processes become more efficient and require less computational resources.
2Productivity
If frame interpolation is used to increase frame rate, then frame rate is improved, but interpolation accuracy decreases when subject moves actively
Solution Approach 1:
The scanning circuit dynamically adjusts the exposure timing and sorting of pixel data based on motion conditions. By flexibly controlling which pixels are read out first and when, the system can maintain accurate temporal relationships even when the subject is moving actively, thereby preserving interpolation accuracy at higher frame rates.
Solution Approach 2:
Pixel data is preliminarily sorted by exposure timing in the scanning circuit before ADC conversion. This preliminary organization ensures that even with active subject motion, the temporal sequence of pixel data is maintained, enabling more accurate motion estimation and frame interpolation.
3Measurement precision
If multiple ADCs are arranged in each divided region, then conversion accuracy is improved, but device complexity and cost increase
Solution Approach 1:
The pixel array is segmented into divided regions, and each region is assigned a single ADC. This segmentation strategy achieves high conversion accuracy through parallel processing across multiple regions while avoiding the complexity of multiple ADCs per region. The system maintains precision by distributing conversion tasks across spatially separated converters.
4Measurement precision
If pixel data is sorted by exposure timing, then frame rate conversion accuracy is improved, but processing time increases
Solution Approach 1:
The scanning circuit performs the sorting of pixel data by exposure timing as a preliminary action during the data readout phase, before the data undergoes further processing. By completing the sorting operation early in the data flow, the system achieves accurate temporal ordering for frame rate conversion without adding significant processing time to the critical path of image generation.
Data Source
AI summary
To facilitate conversion of a frame rate of moving image data in an imaging element that images the moving image data. A pixel array unit is divided into a plurality of divided regions each including a plurality of partial regions. A scanning circuit sequentially performs control of exposing a predetermined number of regions of the plurality of partial regions as first partial regions to output first pixel data in each of the plurality of divided regions, and control of exposing a region different from the first partial regions of the plurality of partial regions as a second partial region to output second pixel data in each of the plurality of divided regions. An image processing unit sequentially performs processing of arraying the first pixel data to generate a first frame and processing of arraying the second pixel data to generate a second frame.