Hybrid Camera Stabilization System for Lens Distortion Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing camera stabilization systems face challenges in accurately correcting camera shake, particularly in still image photography modes, where optical image stabilization is less effective due to lens distortion, and electronic image stabilization struggles with high-frequency camera shakes.

Innovation Solution

A semiconductor system that combines optical and electronic image stabilization by performing optical image stabilization for a portion of camera shake and electronic image stabilization for the remaining amount, using a camera controller and image processing module to enhance correction accuracy and reduce lens distortion effects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If optical image stabilization is used for still image photography, then high-frequency camera shake is corrected, but lens distortion causes deterioration of correction accuracy at the circumferential part of the image

Engineering Contradiction:
Improvecamera shake correction speedVSAvoidcorrection accuracy
Core Design Contradiction:
SpeedVSMeasurement precision

Solution Approach 1:

The patent divides the image stabilization task into two segments: optical image stabilization handles high-frequency camera shake correction, while electronic image stabilization handles low-frequency correction and compensates for lens distortion effects. This segmentation allows each method to operate in its optimal performance range, resolving the contradiction between speed and accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent merges optical image stabilization and electronic image stabilization into a hybrid system where both methods work together. The optical stabilization corrects high-frequency shake through physical lens movement, while electronic stabilization processes the captured image to correct remaining distortion and low-frequency movements, achieving both speed and accuracy.

Inventive Principle:
Principle #5Merging (Combining)

2Adaptability or versatility

If electronic image stabilization is used for moving image photography, then camera shake is corrected, but high-frequency camera shake reduces correction accuracy

Engineering Contradiction:
Improveimage stabilization applicabilityVSAvoidcorrection accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent segments the frequency spectrum of camera shake into high-frequency and low-frequency components. Optical image stabilization is assigned to handle high-frequency corrections where it excels, while electronic image stabilization handles low-frequency corrections, allowing the system to maintain high accuracy across the entire frequency range for moving image photography.

Inventive Principle:
Principle #1Segmentation

3Speed

If only optical image stabilization is used, then high-frequency camera shake is corrected quickly, but correction accuracy deteriorates due to lens distortion

Engineering Contradiction:
Improvecamera shake correction speedVSAvoidstabilization reliability
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

The patent combines optical image stabilization and electronic image stabilization into a unified hybrid system. The optical component provides rapid high-frequency correction, while the electronic component compensates for lens distortion and low-frequency movements, together achieving both speed and reliability in image stabilization.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS10348969B2Camera controller, image processing module, and semiconductor system
Publication Date: 2019.07.09 RENESAS ELECTRONICS CORP
  • US10348969B2 patent drawing
  • US10348969B2 patent drawing
  • US10348969B2 patent drawing

AI summary

A camera module detects a camera shake in an optical axis in an optical system based on a detection result by a vibration detecting sensor. To correct a part amount of a camera shake, the module controls an actuator in a manner that a correction lens shifts in a plane vertical to the optical axis based on an amount of optical image stabilization. To correct a left amount of the camera shake, the module transmits data representing the correction left amount of the camera shake to an image processing module. The image processing module receives the data representing the correction left amount of the camera shake, and changes an effective region of picked-up image data included in frame data, based on an amount of electronic image stabilization in accordance with the correction left amount.