Image Correction Using Zoom-Adaptive Vibration Compensation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Portable image pickup devices, such as CMOS sensors in video cameras, face challenges in recording high-quality images due to image deformation caused by hand shake, which existing vibration removal techniques struggle to address effectively, especially when combined with the increased data processing demands of high-pixel and high-accuracy moving images.

Innovation Solution

An image processing apparatus that detects vibration and calculates correction amounts to correct image deformation, with adjustments based on zoom magnification ratios, including coefficient multiplication and point number setting for correction amounts, to optimize processing efficiency and reduce power consumption.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If vibration removal correction is performed for CMOS sensor images, then image deformation is reduced, but processing time and computational load increase significantly

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent applies parameter changes by adjusting the number of correction points based on the zoom magnification ratio. When the zoom ratio is high, fewer correction points are used, reducing computational load while maintaining adequate correction effectiveness. This dynamic parameter adjustment resolves the contradiction between image quality and processing time.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent uses partial action by selectively applying vibration correction only to necessary regions and using a reduced number of correction points when zoom magnification is high. This partial correction approach maintains sufficient image quality while significantly reducing processing time and computational resources required.

Inventive Principle:
Principle #16Partial or excessive action

2Measurement precision

If correction amounts are calculated for all lines in high zoom ratio images, then correction accuracy is maintained, but power consumption and processing load increase greatly

Engineering Contradiction:
Improvecorrection accuracyVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent changes the parameter of correction point number based on zoom magnification ratio. For high zoom ratios, the number of correction points is reduced, which directly lowers power consumption and processing load while maintaining acceptable correction accuracy through strategic selection of critical correction points.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent segments the correction process by dividing image lines into groups and selecting representative correction points from each group rather than processing all lines individually. This segmentation approach maintains correction accuracy for critical regions while reducing overall processing load and power consumption.

Inventive Principle:
Principle #1Segmentation

3Device complexity

If a single correction amount is used for all lines, then processing is simplified, but correction accuracy decreases for high zoom ratio images

Engineering Contradiction:
Improveprocessing complexityVSAvoidcorrection accuracy
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent dynamically changes the correction approach based on zoom magnification ratio. When the ratio is high, multiple correction points are used instead of a single correction amount, improving accuracy without significantly increasing complexity. The system automatically adapts the correction strategy to match the imaging conditions.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS7627237B2Image processing apparatus and method and program
Publication Date: 2009.12.01 SONY GROUP CORP
  • US7627237B2 patent drawing
  • US7627237B2 patent drawing
  • US7627237B2 patent drawing

AI summary

An image processing apparatus includes an image pickup unit picking up an image with an image pickup device, a vibration amount output unit detecting vibration and outputting a vibration amount indicating a size of the vibration, a calculation unit calculating a first correction amount for reducing influence of the vibration to the image from the vibration amount output by the vibration amount output unit, a determination unit determining whether a zoom magnification ratio at a time that the image is picked up by the image pickup unit is equal to or higher than a predetermined threshold, a generation unit generating a second correction amount based on the first correction amount when the zoom magnification ratio is equal to or higher than the threshold value by the determination unit and a correction unit correcting the image picked up by the image pickup unit based on the first or second correction amount.