Image Sensor Parallel Readout and Feature Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image capturing apparatuses face issues with image quality and decreased frame rates due to sensitivity changes in pixels and sequential processing of image signal readout and feature extraction, which hinder efficient image signal readout and feature extraction processing.
Innovation Solution
An image sensor and image capturing apparatus that performs signal readout and feature extraction processing in parallel using a pixel array, readout unit, output unit, and extraction unit, implemented by processors or circuitry, allowing for efficient image signal processing and feature extraction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If sensitivity is changed for each pixel and processing of adding and reading signals is performed, then feature extraction capability is improved, but image quality deteriorates
Solution Approach 1:
The patent divides the pixel array into multiple pixel blocks, where each block performs independent product-sum calculations for feature extraction. This segmentation allows feature extraction processing to occur at the block level without requiring sensitivity changes across all pixels, thereby maintaining overall image quality while enabling localized feature extraction capabilities.
2Measurement precision
If image signal for one frame is read out and then feature amount is extracted, then processing accuracy is improved, but frame rate decreases
Solution Approach 1:
The patent performs product-sum calculations and feature extraction processing in parallel with the image signal readout process. By preparing feature amounts during the readout phase rather than after complete readout, the system maintains high frame rates while ensuring accurate feature extraction, as the calculations are performed on data as it becomes available without waiting for the entire frame to be read.
3Reliability
If sequential processing of signal readout and feature extraction is performed, then processing reliability is improved, but productivity decreases
Solution Approach 1:
The patent implements parallel processing where the readout unit reads image signals while the extraction unit simultaneously performs feature extraction processing. This continuous parallel operation eliminates idle time between readout and processing, maintaining processing reliability through coordinated operation of both units while significantly improving overall processing efficiency and throughput.
Data Source
AI summary
An image sensor comprises a pixel array having a plurality of pixels arranged in a matrix, a readout unit that controls readout of signals from the plurality of pixels, an output unit that outputs the read signals as an image signal and an extraction unit that performs feature amount extraction processing to extract a feature amount using the read signals. The readout of the signals by the readout unit and the feature amount extraction processing by the extraction unit are processed in parallel.