Image Processing Apparatus Line-By-Line Vibration Compensation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
CMOS image sensors in video cameras face challenges in compensating for shaky hand vibrations, leading to picture distortions due to differences in exposure times between lines, which existing compensation methods fail to fully address, resulting in unnatural or distorted images.
Innovation Solution
An image processing apparatus that includes a vibration detecting unit, a compensation amount calculating unit, a change amount calculating unit, a compensation limit determining unit, and a compensation amount adjusting unit to calculate and adjust the compensation based on the detected vibrations, ensuring the compensation does not exceed the limits, thereby preventing overcompensation and maintaining image quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single compensation value is used for shaky hand correction, then the compensation process is simple, but picture distortions occur due to exposure time differences between lines in CMOS sensors
Solution Approach 1:
The patent divides the picture into multiple lines and calculates compensation values separately for each line based on its specific exposure time. This segmentation approach allows each line to be corrected according to its individual timing characteristics, eliminating the distortion problem caused by using a single compensation value for the entire picture.
Solution Approach 2:
The patent applies different compensation values to different lines of the picture according to their local exposure time characteristics. Each line receives a customized compensation value that matches its specific timing, rather than applying a uniform compensation across the entire image, thereby achieving local optimization of picture quality.
2Manufacturing precision
If compensation values are calculated for each line based on exposure time differences, then picture quality improves, but the calculation complexity and processing time increase
Solution Approach 1:
The patent pre-calculates and stores the exposure time differences for each line during the picture acquisition phase. By preparing this timing information in advance, the subsequent compensation calculation process becomes more efficient, as it can directly use the pre-computed exposure time data rather than recalculating it during image processing.
Solution Approach 2:
The patent introduces an intermediate data structure to store the relationship between line numbers and their corresponding exposure time differences. This intermediary representation simplifies the compensation calculation process by providing direct access to timing information, reducing the computational complexity of determining compensation values for each line.
3Object-affected harmful factors
If overcompensation is applied to correct severe vibrations, then vibration effects are reduced, but unnatural artifacts appear in the corrected picture
Solution Approach 1:
The patent incorporates a feedback mechanism that evaluates the magnitude of vibration and the corresponding compensation amount. When the calculated compensation exceeds a predetermined threshold, the system adjusts the compensation value to prevent overcorrection. This feedback control ensures that compensation is applied only when necessary and within safe limits, avoiding the introduction of unnatural artifacts while still effectively reducing vibration effects.
Data Source
AI summary
An image processing apparatus is disclosed which includes: an imaging unit for taking a picture of an object using an image pickup device; a picture storing unit for storing the picture taken; a vibration detecting unit for detecting an amount of vibration applied to the imaging unit and outputting the detected amount of vibration; a compensation amount calculating unit for calculating an amount of compensation necessary for offsetting effects of the vibration on the imaging unit in accordance with the amount of vibration; a change amount calculating unit for calculating an amount of change in the amount of compensation between predetermined positions; a compensation limit determining unit for determining whether a limit of the compensation available for the picture stored in the picture storing unit is exceeded by the amount of change; a compensation amount adjusting unit for adjusting the amount of compensation depending on whether the limit of the compensation is exceeded, before outputting the adjusted amount of compensation; and a picture correcting unit for correcting the picture stored in the picture storing unit on the basis of the adjusted amount of compensation output by the compensation amount adjusting unit.