Motion-Driven Multi-Shot Image Stabilization via Adaptive Exposure Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image stabilization techniques in cameras face challenges with motion blur due to camera movement during exposure, requiring either expensive motion sensors or high computational and memory resources, especially in small devices with miniaturized image sensors.

Innovation Solution

A hybrid approach that dynamically adjusts the number of image shots and integration time based on detected camera motion, using simple motion sensors like accelerometers to adapt exposure phases, reducing the need for precise motion measurement and minimizing computational and memory requirements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If a single long exposure shot is used to capture an image, then the integration time is increased to improve image quality, but motion blur degradation increases due to camera movement during exposure

Engineering Contradiction:
Improveimage qualityVSAvoidmotion blur
Core Design Contradiction:
Manufacturing precisionVSObject-affected harmful factors

Solution Approach 1:

The patent divides the long exposure time into multiple shorter exposure shots. Instead of taking one long exposure that captures motion blur, the system takes multiple shorter exposures (e.g., 5 shots of 1/10 second each instead of 1 shot of 1/2 second), thereby segmenting the exposure process to reduce motion blur while maintaining total integration time for image quality.

Inventive Principle:
Principle #1Segmentation

2Object-affected harmful factors

If multiple short exposure shots are taken to reduce motion blur, then the number of image shots increases, but computational and memory resources are consumed

Engineering Contradiction:
Improvemotion blurVSAvoidcomputational and memory resources
Core Design Contradiction:
Object-affected harmful factorsVSDevice complexity

Solution Approach 1:

The patent dynamically adjusts the number of shots and exposure time based on detected camera motion. When motion is detected, the system increases the number of shots; when motion is absent, it uses fewer shots. This dynamic adaptation optimizes computational and memory resources by only performing multi-shot processing when necessary, rather than always using the maximum number of shots.

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If expensive motion sensors like gyroscopes are used to detect camera motion, then motion detection accuracy is improved, but device size and cost increase

Engineering Contradiction:
Improvemotion detection accuracyVSAvoiddevice size and cost
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses simple, low-cost accelerometers instead of expensive gyroscopes for motion detection. The accelerometers provide sufficient accuracy for the application by detecting motion thresholds, and their low cost and small size make them suitable for consumer devices. The system achieves effective motion detection without requiring expensive sensing components.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

4Manufacturing precision

If the exposure time is extended to capture more light, then image quality improves, but bias drift error accumulates in motion sensor output

Engineering Contradiction:
Improveimage qualityVSAvoidmotion sensor output accuracy
Core Design Contradiction:
Manufacturing precisionVSMeasurement precision

Solution Approach 1:

The patent segments the long exposure time into multiple shorter exposure intervals. By taking multiple short shots rather than one long shot, the system reduces the accumulation of bias drift error in motion sensor output while maintaining sufficient total integration time for image quality. Each short exposure has minimal drift error, and the combined result achieves both image quality and measurement accuracy.

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach effectively reduces motion blur without the need for expensive motion sensors, minimizes the number of image shots, and adapts to camera motion, achieving efficient image stabilization with low computational and memory costs while maintaining image quality.

Implementation Method 1

any known image sensor needs to have the image projected on it during a period of time referred to herein as integration time

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Implementation Method 2

using simple motion sensors like accelerometers to adapt exposure phases

Methodology Applied
Scientific EffectAccelerometer: Accelerometer

Data Source

PatentUS7965317B2System and method for implementation motion-driven multi-shot image stabilization
Publication Date: 2011.06.21 NOKIA TECHNOLOGIES OY
  • US7965317B2 patent drawing
  • US7965317B2 patent drawing
  • US7965317B2 patent drawing

AI summary

An improved system and method for capturing an image using a camera or a camera module. In the present invention, the number of image shots taken, as well as the integration time of each image shot, are controlled based upon knowledge about the existence or absence of camera motion. Whenever a motion is detected above a predetermined motion threshold, the integration phase of the current image shot ends, and the integration of the next image shot begins. The present invention therefore adapts to the actual camera motion during exposure. If there is no camera motion, a single, long exposed image shot is captured. If there is camera motion, the total exposure time is divided between multiple shots in accordance with the degree of camera motion.