Hybrid OIS EIS Stabilization Removing Overcorrection

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current Optical Image Stabilization (OIS) and Electronic Image Stabilization (EIS) technologies have limitations in correcting for camera rotations along the optical axis and can result in overcorrection when used together, leading to residual camera shake and distortion in images.

Innovation Solution

Combining inertial Electronic Image Stabilization (EIS) with Optical Image Stabilization (OIS) by synchronizing lens movement data from OIS with inertial sensor data to calculate a final correction matrix, which is then applied to stabilize images effectively, removing existing corrections from OIS to prevent overcorrection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If OIS and EIS are used together to stabilize images, then image stabilization effectiveness is improved, but overcorrection occurs leading to residual camera shake and distortion

Engineering Contradiction:

Improveimage stabilization effectivenessVSAvoidimage distortion and residual shake

Core Design Contradiction:

ReliabilityVSManufacturing precision

Solution Approach 1:

The patent segments the image stabilization function into two independent modules: OIS (optical image stabilization) and EIS (electronic image stabilization). Each module operates independently with its own correction calculations, allowing them to work in parallel without interfering with each other's correction logic, thus avoiding overcorrection while maintaining enhanced stabilization effectiveness

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent introduces an image composition module as an intermediary that receives corrected images from both OIS and EIS modules. This intermediary module integrates the corrections from both systems without allowing them to compound, serving as a mediator that combines their benefits while preventing the overcorrection problem that would occur if they operated on the same image data sequentially

Inventive Principle:

Principle #24Intermediary (Mediator)

2Reliability

If OIS corrects for pitch and yaw axis rotations, then motion blur is reduced, but rotation along the optical axis is not corrected causing perspective distortion

Engineering Contradiction:

Improvemotion blur reductionVSAvoidperspective distortion

Core Design Contradiction:

ReliabilityVSManufacturing precision

Solution Approach 1:

The patent extends the correction from two dimensions (pitch and yaw axes handled by OIS) to three dimensions by adding rotation around the optical axis (roll axis) through EIS. This dimensional extension allows comprehensive correction of all rotation types, eliminating perspective distortion while maintaining motion blur reduction benefits

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

3Reliability

If OIS shifts the lens barrel to maintain object position, then image stabilization is achieved, but the range of correction is limited causing distortion when camera moves significantly

Engineering Contradiction:

Improveimage stabilizationVSAvoidcorrection range

Core Design Contradiction:

ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent merges OIS and EIS into a hybrid stabilization system where EIS provides the additional correction range needed for significant camera movements. While OIS handles minor movements through lens shifting, EIS processes entire frames to correct larger movements, combining their strengths to achieve both stabilization and extended adaptability

Inventive Principle:

Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This combination provides improved image quality by accurately correcting for camera movements along all axes, reducing distortion and residual shake, and enhancing the reliability of image stabilization across video sequences.

Implementation Method 1

Some forms of EIS are supplemented with measurements of camera motion provided by camera inertial sensors (IMU)

Methodology Applied

Scientific EffectGyroscope: Gyroscope

Implementation Method 2

Nikon and Canon's implementations of OIS work by using a floating lens element that is moved orthogonally to the optical axis of the lens using electromagnets

Methodology Applied

Scientific EffectElectromagnetic actuation: Electromagnet

Data Source

PatentUS11477382B2Method of stabilizing a sequence of images

Publication Date: 2022.10.18 ADEIA IMAGING LLC

AI summary

A method operable within an image capture device for stabilizing a sequence of images captured by the image capture device is disclosed. The method comprises, using lens based sensors indicating image capture device movement during image acquisition, performing optical image stabilization (OIS) during acquisition of each image of the sequence of images to provide a sequence of OIS corrected images. Movement of the device for each frame during which each OIS corrected image is captured is determined using inertial measurement sensors. At least an estimate of OIS control performed during acquisition of an image is obtained. The estimate is removed from the intra-frame movement determined for the frame during which the OIS corrected image was captured to provide a residual measurement of movement for the frame. Electronic image stabilization (EIS) of each OIS corrected image based on the residual measurement is performed to provide a stabilized sequence of images.