Dual-Mode Pixel Array for Image Stabilization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image stabilization systems in imaging devices are hindered by the cost, size, and weight of separate navigational arrays and gyros, as well as the computational resources required for motion detection and compensation, which are not entirely satisfactory in reducing image blur caused by camera shake.

Innovation Solution

The implementation of dual-mode pixels with both first and second photo-conversion devices within the primary array, where the floating diffusion region is used as a light detector to detect motion, and a correlator and compensator system to opto-mechanically stabilize the image, reducing the need for a separate navigational array and minimizing computational overhead.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If separate navigational arrays and gyros are used for image stabilization, then motion detection capability is improved, but device complexity and cost increase

Engineering Contradiction:
Improvemotion detection capabilityVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent merges the motion detection function with the main imaging pixel array by implementing dual-mode pixels that can operate in both imaging mode and motion detection mode. The same pixel array and floating diffusion regions are used for both capturing images and detecting camera motion, eliminating the need for separate navigational arrays and reducing device complexity.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The pixel array is designed with universal functionality to serve multiple purposes: it acts as both the primary imaging sensor and the motion detection sensor. The dual-mode pixels can switch between imaging and motion detection modes, making the imaging device more versatile while reducing the number of separate components needed.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If separate navigational arrays are used for motion detection, then motion detection accuracy is improved, but size and weight of the imaging device increase

Engineering Contradiction:
Improvemotion detection accuracyVSAvoiddevice weight
Core Design Contradiction:
Measurement precisionVSWeight of moving object

Solution Approach 1:

The patent combines the motion detection function with the main imaging pixel array, eliminating the need for separate navigational arrays. By using the same pixel array for both imaging and motion detection, the overall device weight is reduced while maintaining motion detection accuracy through the dual-mode pixel operation.

Inventive Principle:
Principle #5Merging (Combining)

3Manufacturing precision

If conventional pixels with multiple transistors are used, then image capture functionality is improved, but pixel area and device size increase

Engineering Contradiction:
Improveimage capture functionalityVSAvoidpixel area
Core Design Contradiction:
Manufacturing precisionVSArea of moving object

Solution Approach 1:

The patent extracts the motion detection function from separate dedicated pixels and implements it within the existing imaging pixel structure. By utilizing the floating diffusion region for dual purposes (imaging and motion detection), the design removes redundant components and reduces the overall pixel area required.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The pixel design incorporates multi-functionality where the same pixel structure performs both imaging and motion detection. This universal approach allows a single pixel to serve multiple purposes, reducing the total pixel area needed compared to having separate dedicated pixels for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Area of moving object

If dual-mode pixels with shared floating diffusion region are used, then pixel area is reduced, but charge transfer timing complexity increases

Engineering Contradiction:
Improvepixel areaVSAvoidcharge transfer timing complexity
Core Design Contradiction:
Area of moving objectVSDevice complexity

Solution Approach 1:

The patent employs periodic action through sequential mode switching, where pixels alternately operate in imaging mode and motion detection mode at different time intervals. This time-division multiplexing approach manages the complexity of charge transfer by establishing regular, periodic timing sequences rather than requiring simultaneous multi-function operation.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The pixel operation is made dynamic through flexible mode switching capabilities. The pixel can adaptively change between imaging and motion detection modes based on timing signals, allowing the system to dynamically allocate pixel functionality and manage charge transfer timing complexity through adaptive control.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach effectively reduces image blur by accurately detecting and compensating for camera motion using dual-mode pixels and a correlator, while minimizing the size, weight, and computational requirements, thus enhancing image stabilization efficiency.

Implementation Method 1

a first photo-conversion device, shown as a pinned photodiode 305, for generating charge in response to external light incident on the pixel

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Implementation Method 2

the floating diffusion region is used as a light detector to detect motion

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Data Source

PatentUS8253810B2Method, apparatus and system for image stabilization using a single pixel array
Publication Date: 2012.08.28 APTINA IMAGING CORP
  • US8253810B2 patent drawing
  • US8253810B2 patent drawing
  • US8253810B2 patent drawing

AI summary

An imaging pixel array and associated method and system are disclosed in which the array contains first pixels each having a first photo-conversion device, and second pixels each having a first photo-conversion device and a second photo-conversion device. The first photo-conversion devices are configured to acquire an image during a first integration period. The second photo-conversion devices are configured to acquire a plurality of images during the first integration period. A circuit uses the plurality of image signals and determines from them relative motion between the array and an image during a portion of the first integration period and provides a signal representing the motion which is used for image stabilization.