Dynamic Overlap Adjustment for Camera Shake Correction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing camera systems face challenges in correcting camera shake while dividing images for processing, as they require large overlap regions and significant processing power, leading to video delay and inefficiency, especially when using multiple image processing processors.
Innovation Solution
An imaging apparatus that dynamically adjusts the overlap between divided images based on deformation processing, allowing for efficient camera shake correction with minimal video delay by changing the readout positions and optimizing the overlap region according to the deformation amount calculated by image processing units.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If large overlap regions are included in divided images for camera shake correction, then image continuity at boundary portions is maintained, but image processing time increases and video delay becomes large
Solution Approach 1:
The patent applies dynamics by making the overlap region size variable rather than fixed. The division unit dynamically adjusts the overlap amount between divided images based on the deformation amount calculated by the image deformation amount calculation unit. When deformation is large, larger overlap regions are provided to maintain image continuity; when deformation is small, smaller overlap regions are used to reduce processing time and video delay.
2Reliability
If image processing ability is increased to handle large overlap regions, then camera shake correction quality improves, but device complexity and processing cost increase
Solution Approach 1:
The system dynamically adjusts the processing load on image processing processors based on the calculated deformation amount. When deformation is small, less processing power is needed, allowing the use of processors with lower image processing ability. When deformation is large, the system provides larger overlap regions and adjusts processing accordingly, matching the processing capability requirements to the actual needs rather than always requiring high-end processors.
3Reliability
If readout positions are changed for camera shake correction in divided images, then shaking correction is achieved, but overlap regions must be enlarged to prevent boundary discontinuity
Solution Approach 1:
The patent implements feedback by using the image deformation amount calculation unit to calculate the deformation amount based on shaking information, then feeding this information back to the division unit which adjusts the overlap region size accordingly. This closed-loop control ensures that overlap regions are enlarged only when necessary to maintain image continuity at boundary portions after readout position changes for shake correction.
4Productivity
If multiple image processing processors are used to divide and process images, then processing speed improves, but coordinating processing across processors increases device complexity
Solution Approach 1:
The patent applies segmentation by dividing the image processing task into multiple independent processors, where each processor handles specific divided images with adjusted overlap regions. The division unit segments the input image into multiple divided images with variable overlap amounts, and each image processing processor independently performs image processing on its assigned divided images based on the calculated deformation amount, reducing coordination complexity while maintaining processing speed.
Data Source
AI summary
An image processing apparatus includes a division unit configured to divide one frame image into a plurality of divided images, a plurality of image processing units configured to respectively process the plurality of divided images, and a combining unit configured to combine the divided images respectively subjected to image deformation processing by the plurality of image processing units, wherein the division unit changes an amount of overlap between the plurality of divided images according to a deformation amount of the image deformation processing performed on the divided image calculated by the image processing unit.