Parallax Image Sensor Signal Segmentation for Data Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Image capture apparatuses face challenges in real-time processing of parallax images due to high processing loads and data transmission requirements, especially during moving image shooting, which can exceed the processing power of the device and require significant memory for storing and processing A and B image signals.
Innovation Solution
The apparatus includes an image sensor with pixels having multiple photoelectric conversion units, where a first image signal is generated from all photoelectric signals, and a second image signal is generated from selected photoelectric signals, with the second image signal being output less frequently than the first, reducing data transmission and storage needs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If image signals from all photoelectric conversion units are transmitted for each pixel, then accurate parallax calculation is enabled, but data transmission amount doubles compared to conventional sensors
Solution Approach 1:
The image signal is segmented into two types: first image signals generated from all photoelectric conversion units for accurate parallax calculation, and second image signals generated from selected photoelectric conversion units for reduced data transmission. This segmentation allows the system to transmit only necessary data while maintaining calculation accuracy.
Solution Approach 2:
Instead of transmitting all image signals in every frame, the system transmits second image signals (from selected photoelectric conversion units) less frequently than first image signals. This partial transmission approach reduces data amount while still enabling accurate parallax calculation when needed.
2Speed
If real-time parallax calculation is performed for moving images, then focus detection speed is improved, but processing load exceeds the capability of the image capture apparatus
Solution Approach 1:
The system performs full parallax calculation using first image signals at reduced frame rates, and uses second image signals for intermediate updates. This partial calculation approach enables real-time focus detection while keeping processing load within the apparatus's capabilities.
Solution Approach 2:
The system periodically transmits first image signals for comprehensive parallax calculation, interspersed with less frequent transmission of second image signals. This periodic action pattern allows real-time processing by breaking down continuous heavy computation into manageable periodic tasks.
3Adaptability or versatility
If both A image and B image signals are stored for post-processing, then flexible image processing is enabled, but memory capacity requirements double
Solution Approach 1:
Image data is segmented into first image signals (from all photoelectric conversion units) and second image signals (from selected photoelectric conversion units). The system stores both types with different frequencies, enabling flexible post-processing while reducing overall storage requirements through selective retention of detailed data.
Solution Approach 2:
The system applies different storage qualities to different data types: first image signals are stored with higher fidelity and frequency for areas requiring detailed analysis, while second image signals are stored less frequently for general purposes. This local quality differentiation maintains processing flexibility while optimizing memory usage.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach allows for real-time calculation of parallax while minimizing data transmission and storage requirements, enabling efficient processing and reducing the burden on the image capture apparatus, even during high-frame-rate shooting.
Implementation Method 1
an image sensor that is provided with a plurality of pixels each including a plurality of photoelectric conversion units, wherein each of the photoelectric conversion units generates an photoelectric signal
Data Source
AI summary
Disclosed are an image capture apparatus that includes an image sensor capable of acquiring parallax images, and calculates the amount of parallax while reducing the amount of data that is to be transmitted or recorded, and a method for controlling the same. The image capture apparatus less frequently outputs a second image signal than a first image signal, wherein the first image signal is generated based on all of the photoelectric signals of the plurality of photoelectric conversion units of each pixel, and wherein the second image signal is generated based on at least one of but not all of the photoelectric signals.