Rolling Shutter Image Distortion Correction via Displacement Vector Averaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Rolling shutter type exposure in image capturing devices causes image distortion due to varying exposure starting times for each pixel or line of pixels, leading to hand shake-induced distortions in captured images.

Innovation Solution

An image processor is developed with components for detecting similar image regions, calculating displacement vectors, and shifting these regions to their average position across multiple frames, thereby correcting image distortions caused by hand shake and rolling shutter effects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Duration of action of stationary object

If rolling shutter type exposure is used, then the exposure time period can be kept same for each pixel, but different exposure starting time causes hand shake distortion

Engineering Contradiction:
Improveexposure time periodVSAvoidhand shake distortion
Core Design Contradiction:
Duration of action of stationary objectVSObject-affected harmful factors

Solution Approach 1:

The image is divided into multiple frame images, and similar image regions are detected across these frames. By segmenting the correction process into detecting similar regions, calculating displacement vectors, and applying corrections frame-by-frame, the patent addresses hand shake distortion while preserving the rolling shutter exposure characteristics.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the parameter of exposure starting time by detecting displacement vectors of similar image regions across multiple frames. It calculates the average displacement vector and applies it to correct the hand shake distortion, effectively adjusting the temporal parameter without changing the fundamental rolling shutter exposure mechanism.

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If multiple frame images are processed to correct distortion, then image quality improves, but processing complexity increases

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent performs preliminary detection of similar image regions and calculation of displacement vectors before applying the final correction. By pre-processing the multiple frame images to identify similar regions and compute their displacement characteristics, the system prepares correction data in advance, improving image quality while managing processing complexity through structured preliminary steps.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent detects similar image regions across multiple frames and uses these copied regions to calculate displacement vectors. By copying and comparing corresponding regions from different frames, the system can accurately determine hand shake patterns and apply corrections, improving image quality through multi-frame analysis.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS7720309B2Image processor and camera system, image processing method, and motion picture displaying method
Publication Date: 2010.05.18 MEGACHIPS
  • US7720309B2 patent drawing
  • US7720309B2 patent drawing
  • US7720309B2 patent drawing

AI summary

A similar-image detecting part detects similar image regions similar to one another in a plurality of frame images captured by rolling shutter type exposure. A displacement-vector detecting part detects a displacement vector of each of the similar image regions with respect to a reference position in each of the plurality of frame images. An average calculating part calculates an average of displacement vectors in the plurality of frame images. A correcting part shifts a similar image region in one of the plurality of frame images such that the displacement vector of the similar image region becomes the average calculated by the average calculating part.