Image Registration via Motion Vector Table for Anti-Shake

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current anti-shake methods in mobile terminals, such as optical image stabilization (OIS) and electronic image stabilization (EIS), are inadequate for scenarios with strong hand tremors or long exposure times, leading to blurry images and a poor user experience.

Innovation Solution

A terminal device equipped with a lens module, image signal processor, central processing unit, and gyro sensor collects multiple image frames, processes angular acceleration data to determine shake information, and performs registration and fusion of images using a preset motion vector table to generate a clear, compressed image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If software-based registration is used to achieve anti-shake, then registration accuracy can be improved, but photographing time increases and user experience deteriorates

Engineering Contradiction:
Improveregistration accuracyVSAvoidphotographing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent pre-calculates and stores motion vectors for various shake scenarios in a motion vector table before actual photographing. During photographing, the system only needs to lookup and apply the pre-computed motion vectors based on detected shake parameters, rather than performing complex real-time registration calculations. This preliminary preparation resolves the contradiction by making the registration process extremely fast while maintaining high accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates a simplified model of the registration process by pre-computing motion vectors for different shake conditions and storing them in a lookup table. Instead of performing full registration calculations on actual images in real-time, the system copies and applies pre-determined motion compensation parameters based on matched shake patterns, significantly reducing processing time while preserving registration quality.

Inventive Principle:
Principle #26Copying

2Reliability

If OIS is used to achieve anti-shake, then shake compensation can be improved, but application to high shake scenarios and long-exposure mode is limited

Engineering Contradiction:
Improveanti-shake performanceVSAvoidapplication scenario range
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent merges OIS hardware-based shake compensation with EIS software-based image registration to create a hybrid anti-shake system. The OIS component handles physical lens stabilization for moderate shake, while the EIS component processes multiple frames with motion vector compensation for residual shake and extreme scenarios. This combination resolves the contradiction by extending OIS capabilities to handle both moderate and high shake scenarios including long-exposure photography.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent creates a multi-functional anti-shake system that can adapt to various shake intensities and photographing modes. The hybrid system universally handles different scenarios: OIS manages physical stabilization for normal conditions, while EIS with motion vector tables manages residual compensation for high shake and long-exposure scenarios. This universal approach resolves the limitation of OIS by making the system adaptable to all shake levels and exposure modes.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Manufacturing precision

If multiple image frames are collected and processed, then image quality can be improved, but processing complexity and time increase

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent pre-calculates motion vectors for various shake intensities and directions and stores them in a lookup table before actual photographing. When processing multiple image frames, the system detects shake parameters and directly retrieves the corresponding pre-computed motion vectors, avoiding complex real-time calculations. This preliminary preparation resolves the contradiction by maintaining high image quality from multiple frames while significantly reducing processing complexity and time.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach effectively improves image quality and photographing performance by compensating for hand tremors, even in scenarios with strong shakes or long exposure times, enhancing the overall user experience.

Implementation Method 1

the gyro sensor is configured to: when the terminal device collects data of each of the M image frames of the photographed object, obtain angular acceleration of the terminal device in an X-axis direction, a Y-axis direction, and a Z-axis direction

Methodology Applied
Scientific EffectGyroscopic effect: Gyroscope

Data Source

PatentUS10547785B2Photographing method including image registration based on reference image, shake information, and a motion vector table
Publication Date: 2020.01.28 HUAWEI TECH CO LTD
  • US10547785B2 patent drawing
  • US10547785B2 patent drawing
  • US10547785B2 patent drawing

AI summary

A photographing method includes: collecting, by a terminal device, data of M image frames of a photographed object, and processing the data of the M image frames to obtain M image frames; when collecting data of each of the M image frames of the photographed object, obtaining angular acceleration of the terminal device in an X-axis direction, a Y-axis direction, and a Z-axis direction; processing—the obtained angular acceleration in a period corresponding to the data of each image frame into shake information; selecting—one image frame from the M image frames as a reference image, performing registration on each of (M−1) image frames based on the reference image, the shake information, and a preset motion vector table, and performing fusion on the registered images; and displaying the compressed image.