Hybrid OIS and EIS Stabilization for Motion Blur
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current image stabilization techniques, particularly electronic image stabilization (EIS), struggle to effectively address motion blur in video frames, especially in low light conditions, where longer integration times exacerbate the issue, leading to residual motion blur and shimmering artifacts.
Innovation Solution
A method that combines optical image stabilization (OIS) and electronic image stabilization (EIS) by using high-pass filtering of motion data to adjust stabilization strengths based on estimated motion blur, lens position, and light levels, allowing for real-time correction of motion blur during video capture.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Stability of the object's composition
If electronic image stabilization (EIS) is used to stabilize video frames, then frame-to-frame distortion is corrected, but motion blur within images is not adequately addressed
Solution Approach 1:
The patent combines optical image stabilization (OIS) and electronic image stabilization (EIS) into a hybrid stabilization system. OIS corrects motion blur during capture by physically stabilizing the lens or sensor, while EIS corrects frame-to-frame distortion through software transformations. The system merges both techniques to simultaneously address motion blur and frame stability issues that neither technique can resolve alone.
2Illumination intensity
If longer integration times are used in low light conditions, then sufficient light is captured, but motion blur increases
Solution Approach 1:
The system performs preliminary stabilization action during the exposure period by using OIS to physically counteract camera motion while the sensor is integrating light. This preliminary correction of motion during capture, combined with post-capture EIS processing, allows longer integration times in low light without proportionally increasing motion blur, as the stabilization system is already compensating for movement throughout the exposure.
3Speed
If OIS moves lens elements to correct camera shake, then real-time stabilization is achieved, but correction range is limited by physical size
Solution Approach 1:
The patent extends the correction range by adding the software-based EIS dimension to the hardware-based OIS system. While OIS provides real-time physical correction with limited range due to device size constraints, EIS adds a second dimension of correction through digital image transformation that can handle larger stabilization movements. This multi-dimensional approach allows the system to achieve both real-time response and extended correction range.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach provides improved video stabilization performance in low light conditions by intelligently modulating the strengths of OIS and EIS techniques, reducing motion blur and shimmering artifacts, resulting in more natural and stable video output.
Implementation Method 1
Another approach may use the output from a motion sensor, e.g., a gyroscope, as an input for estimating the amount of 'warping' that needs to be done via the EIS transformations in order to stabilize the video frames
Implementation Method 2
The method includes performing a high-pass filtering operation on the motion information
Data Source
AI summary
Techniques to improve a digital image capture device's ability to stabilize a video stream are presented. According to some embodiments, improved stabilization of captured video frames is provided by intelligently harnessing the complementary effects of both optical image stabilization (OIS) and electronic image stabilization (EIS). In particular, OIS may be used to remove intra-frame motion blur that is typically lower in amplitude and dominates with longer integration times, while EIS may be used to remove residual unwanted frame-to-frame motion that is typically larger in amplitude. The techniques disclosed herein may also leverage information provided from the image capture device's OIS system to perform improved motion blur-aware video stabilization strength modulation, which permits better video stabilization performance in low light conditions, where integration times tend to be longer, thus leading to a greater amount of motion blurring in the output stabilized video.