Image Stabilization Using Reference Frame Updates

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image stabilization methods for hand-held devices suffer from errors in calculation, leading to incomplete removal of shaking in image sequences, with real motion path based processing converting images only once and relative motion path based processing experiencing accumulative errors.

Innovation Solution

An image processing method that determines a target image as a reference image based on fluctuations meeting predetermined requirements, using inter frame estimation to reduce the negative influence of large fluctuations and update the reference image to improve image stabilization, and performs vertical correction and smoothing to align images with the user's field of vision.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If real motion path based processing is used to calculate pose and convert to vertical state, then image stabilization is achieved, but shaking still exists due to calculation errors

Engineering Contradiction:
Improveimage stabilization effectVSAvoidpose calculation accuracy
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The patent uses gyroscope data to continuously monitor and detect device orientation changes, feeding this information back to adjust image stabilization parameters in real-time, improving both reliability and precision of stabilization

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent introduces an intermediary processing layer that combines gyroscope data with image frame analysis, using this intermediate information to correct pose calculation errors and enhance stabilization accuracy

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If relative motion path based processing is used to adjust pose of each current image, then accumulative error is reduced, but image stabilization effect is still not good

Engineering Contradiction:
Improvemotion estimation accuracyVSAvoidimage stabilization effect
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent merges real motion path based processing and relative motion path based processing into a unified approach, combining the strengths of both methods to achieve better image stabilization while reducing accumulative errors

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent creates a composite processing approach that integrates multiple stabilization techniques (gyroscope-based pose calculation, inter-frame motion estimation, and error correction mechanisms) to form a robust image stabilization system

Inventive Principle:
Principle #40Composite materials

Data Source

PatentEP3413555B1Image processing method and device as well as computer program and non-transitory computer-readable medium
Publication Date: 2020.08.05 RICOH CO LTD
  • EP3413555B1 patent drawingFigure 1
  • EP3413555B1 patent drawingFigure 2A~2D
  • EP3413555B1 patent drawingFigure 3(a)~3(d)

AI summary

Image processing method and device are disclosed. The image processing method is inclusive of a step of obtaining a target image; a step of performing motion estimation on the target image so as to attain motion paths; a step of determining, on the basis of the motion paths, whether there exists a fluctuation meeting a predetermined requirement in the target image; and a step of taking, if there exists a fluctuation meeting the predetermined requirement in the target image, the target image as a reference image. The reference image is utilized to carry out inter frame motion estimation with respect to the respective images acquired.