Polarization Pixels Switching Calculation Load for Frame Rate
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image capturing devices face challenges in maintaining a proper frame rate when acquiring videos using polarization information, as the calculation load for generating luminance information at arbitrary polarization angles is high, leading to reduced frame rates and impaired real-time video display.
Innovation Solution
The image capturing apparatus includes polarization pixels that detect polarization information and employs a calculation unit to perform either first or second polarization calculations, which are less computationally intensive, allowing for switching between these calculations based on predetermined timing, modes, or detected states to optimize frame rate.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If first polarization calculation is performed on all pixels for every frame, then polarization information accuracy is improved, but frame rate is reduced due to high calculation load
Solution Approach 1:
The image capturing apparatus divides pixels into different types (first polarization pixels, second polarization pixels, third polarization pixels) with different calculation requirements. Full polarization calculation is performed only on selected pixels (e.g., first polarization pixels) while simplified calculations or alternative methods are used for other pixel types, thereby reducing overall calculation load while maintaining polarization information quality
Solution Approach 2:
Instead of performing complete polarization calculation on all pixels for every frame, the system performs full calculation only on a subset of pixels (partial action) that are most critical for polarization information. Other pixels use simplified methods, achieving acceptable polarization information with reduced computational effort
2Measurement precision
If frame rate is reduced to allow complete polarization calculation, then polarization information quality is improved, but real-time video display capability is worsened
Solution Approach 1:
The system dynamically adjusts the polarization calculation method based on operational mode. In still image shooting mode, full polarization calculation is performed on all pixels to maximize quality. In moving image shooting mode, the system switches to simplified calculation methods on selected pixels to maintain high frame rates and real-time display capability, thus adapting to different speed requirements
3Productivity
If simplified polarization calculation is used, then frame rate is improved, but polarization information processing capability is reduced
Solution Approach 1:
Different pixel types are assigned different calculation methods based on their specific roles. First polarization pixels receive full polarization calculation to maintain high processing capability, while second and third polarization pixels use simplified methods. This local differentiation allows the system to achieve high frame rates overall while preserving polarization information processing capability where most needed
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enables the image capturing apparatus to set a proper frame rate according to the shooting situation, reducing the impact of high calculation loads on frame rate and improving the real-time display of videos by switching between different polarization calculation methods.
Implementation Method 1
polarization pixels that detect polarization information of a plurality of different direction
Data Source
AI summary
An image capturing apparatus that has an image capturing device including polarization elements and sets a proper frame rate according to a situation when acquiring a video using polarization information. The image capturing device an image capturing device including polarization pixels that detect polarization information of a plurality of different directions. The polarization information of the polarization pixels is determined by performing first polarization calculation or second polarization calculation which is smaller in calculation load than the first polarization calculation, on video signals output from the polarization pixels. A polarization-processed image is generated by using the polarization information. The first polarization calculation and the second polarization calculation are switched according to a predetermined timing, a mode, or a result of detecting a predetermined state.