Camera Module Stabilization Using Residual Motion Correction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current Optical Image Stabilization (OIS) and Electronic Image Stabilization (EIS) technologies have limitations in correcting for camera rotations along the optical axis and can result in overcorrection when used together, leading to residual camera shake and distortion in images.
Innovation Solution
A camera module that synchronizes lens movement data from OIS with inertial sensor data to calculate a final correction matrix, which is then applied to stabilize images by removing existing OIS corrections and accounting for camera orientation changes, ensuring accurate frame-to-frame stabilization without introducing distortion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If OIS and EIS are used together to stabilize images, then motion blur is reduced, but overcorrection occurs leading to residual camera shake and distortion
Solution Approach 1:
The system uses feedback from both OIS lens position data and EIS inertial sensor measurements to continuously monitor and adjust the stabilization correction. The feedback loop compares the combined correction with the actual camera motion and adjusts the final correction matrix to prevent overcorrection, thereby maintaining both high accuracy and reliability.
Solution Approach 2:
The patent dynamically changes the correction parameters by calculating a final correction matrix that combines OIS and EIS data with different weighting factors. By adjusting the contribution of each stabilization method based on current camera motion characteristics, the system optimizes the balance between correction accuracy and avoidance of overcorrection.
2Device complexity
If OIS corrects only pitch and yaw axis rotations, then lens movement is simplified, but rotation along the optical axis and perspective distortion are not compensated
Solution Approach 1:
The patent merges OIS (which handles pitch and yaw) with EIS (which handles optical axis rotation and perspective distortion) into a unified stabilization system. The combination allows the system to compensate for all types of camera motion including those that OIS alone cannot correct, thereby increasing adaptability without significantly increasing mechanical complexity.
Solution Approach 2:
The system adds the digital processing dimension through EIS to complement the mechanical OIS dimension. While OIS operates in the physical lens movement domain, EIS operates in the digital image processing domain, adding the capability to correct perspective distortion and optical axis rotations that are beyond mechanical lens adjustment.
3Manufacturing precision
If OIS shifts the lens to compensate for camera rotation, then image position on sensor is maintained, but perspective projection changes are not corrected and distortion results
Solution Approach 1:
The patent introduces an intermediary digital correction step between OIS mechanical stabilization and the final image output. The EIS component acts as an intermediary that analyzes the original frame data and applies geometric transformations to correct perspective distortion, thereby preserving both image position stability and geometric accuracy.
Solution Approach 2:
The system replaces the need for complex mechanical solutions that would attempt to correct perspective distortion through lens movement alone. Instead, it uses digital image processing to substitute for the mechanical limitation, applying computational geometry transformations to achieve accurate perspective correction without additional mechanical complexity.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach effectively stabilizes images by accurately accounting for camera motion and lens position, reducing residual shake and distortion, and improving the reliability of image stabilization across various camera movements.
Implementation Method 1
knowing the camera intrinsic properties, the motion in the sensor plane can be recreated and filtered
Implementation Method 2
Nikon and Canon's implementations of OIS work by using a floating lens element that is moved orthogonally to the optical axis of the lens using electromagnets
Data Source
Figure 1(a)~1(c)
Figure 2(a)~2(b)
Figure 3
AI summary
A method operable within an image capture device for stabilizing a sequence of images captured by the image capture device is disclosed. The method comprises,using lens based sensors indicating image capture device movement during image acquisition, performing optical image stabilization (OIS) during acquisition of each image of the sequence of images to provide a sequence of OIS corrected images. Movement of the device for each frame during which each OIS corrected image is captured is determined using inertial measurement sensors. At least an estimate of OIS control performed during acquisition of an image is obtained. The estimate is removed from the intra-frame movement determined for the frame during which the OIS corrected image was captured to provide a residual measurement of movement for the frame. Electronic image stabilization (EIS) of each OIS corrected image based on the residual measurement is performed to provide a stabilized sequence of images.