Digital Anti-Shake via Motion Path Smoothing and Coordinate Transformation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video anti-shake technologies, such as mechanical, optical, and digital anti-shake, are either costly, hardware-dependent, or suffer from low stability due to limitations in image feature matching, especially in scenes with unclear content and large motion ranges.

Innovation Solution

An anti-shake image processing method that uses internal sensors to obtain the device's posture, smooth the motion path, and perform coordinate transformations to correct images, reducing the impact of device shake on captured video at a low cost and with high efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If mechanical anti-shake technology using PTZ is used, then anti-shake effect is remarkable, but device cost is high

Engineering Contradiction:
Improveanti-shake effectVSAvoiddevice cost
Core Design Contradiction:
ReliabilityVSEase of manufacture

Solution Approach 1:

The patent replaces mechanical anti-shake systems (PTZ) with a digital image processing system. The processor performs coordinate transformations and image corrections based on detected device motion, eliminating the need for expensive mechanical stabilization components while achieving comparable anti-shake effects.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates a virtual stable image by copying and transforming the captured image data through coordinate systems. Instead of physically stabilizing the camera, it generates a corrected image that appears stable by mapping pixels from the motion-affected image to a stabilized coordinate framework.

Inventive Principle:
Principle #26Copying

2Reliability

If optical anti-shake with movable components is used, then anti-shake effect is stable, but device cost is high

Engineering Contradiction:
Improveanti-shake effectVSAvoiddevice cost
Core Design Contradiction:
ReliabilityVSEase of manufacture

Solution Approach 1:

The patent substitutes optical anti-shake mechanisms (movable lenses or mirrors) with a purely digital processing approach. The processor calculates and applies coordinate transformations to stabilize the image, removing the need for complex optical moving parts and reducing manufacturing costs.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system creates a stabilized image copy through digital coordinate transformation. By mapping image data from the actual device coordinates to virtual stable coordinates, it generates a corrected image that replicates what would have been captured if the device had remained stable.

Inventive Principle:
Principle #26Copying

3Device complexity

If digital anti-shake with image feature matching is used, then processing is simple, but stability is low in scenes with unclear content

Engineering Contradiction:
Improveprocessing simplicityVSAvoidprocessing stability
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent changes the fundamental parameter for anti-shake from image content features to device motion parameters. Instead of relying on feature matching that fails with unclear content, it uses coordinate transformation based on device motion detection, which remains effective regardless of image content quality.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent replaces the image feature matching mechanism with a coordinate system transformation mechanism. This substitution eliminates the vulnerability to unclear image content while maintaining processing efficiency through mathematical transformations.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11770613B2Anti-shake image processing method, apparatus, electronic device and storage medium
Publication Date: 2023.09.26 BLACK SESAME TECH INC
  • US11770613B2 patent drawing
  • US11770613B2 patent drawing
  • US11770613B2 patent drawing

AI summary

An anti-shake image processing method, apparatus, electronic device and storage medium are disclosed. The method includes the following steps. A current actual posture of an imaging device at a current shooting moment of capturing an original image of current frame and multiple reference actual postures of the imaging device at multiple shooting moments of capturing the original images of adjacent multiple frames of the original image of the current frame are obtained. A path smoothing process is performed to determine a current virtual posture after path smoothing at the current shooting moment. A coordinate transformation is performed on the original image of the current frame captured in the current actual posture to an estimated position of the original image of the current frame when captured in the current virtual posture in a pixel coordinate system to obtain a first correction image of the current frame.