Dual Sensor Image Stabilization Using Motion Vector Correlation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Handheld devices struggle to capture high-quality images due to handshake-induced jitter, especially in challenging environments, as existing image stabilization methods require additional circuitry and increased power consumption.

Innovation Solution

A system that includes a primary image sensor, a secondary image sensor, a correlation circuit to calculate motion vectors, and a data processor to process image data, using a system-on-chip with a keypad interface, LCD interface, and memory controller to synchronize and correct image data for jitter compensation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If image stabilization modules use mechanical gyroscopes or MEMS gyroscopes to generate motion vectors, then jitter compensation capability is improved, but device complexity and size increase

Engineering Contradiction:
Improvejitter compensation capabilityVSAvoiddevice complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent extracts the motion vector calculation function from dedicated gyroscope hardware and implements it through image processing algorithms that analyze motion vectors directly from image data, eliminating the need for separate gyroscope components

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent replaces mechanical gyroscope systems with an optical/electronic approach where motion vectors are derived from analyzing changes in image data across multiple frames, substituting mechanical measurement with computational analysis

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If image stabilization modules compensate for jitter by adjusting image data after processing, then jitter compensation is achieved, but power consumption increases

Engineering Contradiction:
Improvejitter compensation capabilityVSAvoidpower consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent performs preliminary actions by calculating motion vectors from reference images captured before the main image capture, allowing jitter compensation to be prepared in advance and applied more efficiently during the actual image processing

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent maintains continuity of useful action by integrating motion vector calculation into the existing image processing pipeline, ensuring that motion compensation is performed continuously and efficiently without requiring separate high-power processing stages

Inventive Principle:
Principle #20Continuity of useful action

3Weight of moving object

If handheld devices are downsized to be smaller and lighter, then portability is improved, but image data generation capability deteriorates

Engineering Contradiction:
Improvedevice weightVSAvoidimage data generation capability
Core Design Contradiction:
Weight of moving objectVSProductivity

Solution Approach 1:

The patent merges multiple functions including image capture, motion vector calculation, and jitter compensation into a single integrated processing pipeline, allowing the device to maintain image quality capabilities while reducing overall component count and size

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent implements a universal image processing pipeline that handles multiple tasks (image capture, motion analysis, jitter compensation) through a single integrated system, allowing the downsized device to perform complex image processing functions without requiring separate dedicated components for each function

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS8625926B1Method and apparatus for processing image data from a primary sensor and a secondary sensor
Publication Date: 2014.01.07 MARVELL ASIA PTE LTD
  • US8625926B1 patent drawing
  • US8625926B1 patent drawing
  • US8625926B1 patent drawing

AI summary

Systems and methods are provided for processing image data captured by a device. In one implementation, a system is provided to process primary image data based on motion of the device during generation of the image data, as detected by a secondary image sensor. In another implementation, a method is provided for processing image data by generating primary image data, generating secondary image data, calculating, using the secondary image data, at least one motion vector based on motion of the device during generation of the primary image data, processing the primary image data based on the at least one motion vector, and outputting the processed primary image data.