Bayer Order Correction for Image Stabilization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image sensors, particularly CMOS image sensors, face challenges in effectively correcting for shaking or motion during image capture, which affects image quality and stability, especially in mobile devices where space and power efficiency are critical.

Innovation Solution

The implementation of a method for processing image signals using a gyro sensor to perform shaking correction on Bayer pattern images, involving Bayer order status information generation, translation correction, and interpolation, integrated within an image signal processor and image sensor chip to generate stable RGB images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Stability of the object's composition

If translation correction is performed on Bayer pattern image using gyro information, then image stability is improved, but Bayer order may be changed causing interpolation errors

Engineering Contradiction:
Improveimage stabilityVSAvoidBayer order accuracy
Core Design Contradiction:
Stability of the object's compositionVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by generating Bayer order status information before performing translation correction. The system calculates whether the Bayer order will change based on translation information from gyro sensors, and prepares appropriate interpolation filters in advance. This allows the system to proactively handle potential Bayer order changes rather than reacting to them after they occur, thereby maintaining both image stability and Bayer order accuracy.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If extensive frame memory is used for electronic image stabilization, then correction accuracy is improved, but device complexity and power consumption increase

Engineering Contradiction:
Improvecorrection accuracyVSAvoidmemory requirement
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts only the essential translation information from gyro sensors that is needed for correction, rather than processing entire frame data. By focusing on extracting and utilizing only the necessary motion parameters (translation, rotation, shear) from the gyro information, the system achieves correction accuracy without requiring extensive frame memory, thereby reducing device complexity and power consumption.

Inventive Principle:
Principle #2Taking out (Extraction)

3Manufacturing precision

If real-time shaking correction is performed, then image quality is improved, but processing time and power consumption increase

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent applies parameter changes by dynamically selecting interpolation filters based on Bayer order status information. When translation correction causes a Bayer order change, the system switches to a different interpolation filter that is appropriate for the corrected order. This parameter change approach allows real-time correction with maintained image quality without requiring extensive processing time, as the system efficiently adapts processing parameters rather than reprocessing entire frames.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11159722B2Method for processing image signal, image signal processor, and image sensor chip
Publication Date: 2021.10.26 MIMIRIP LLC
  • US11159722B2 patent drawing
  • US11159722B2 patent drawing
  • US11159722B2 patent drawing

AI summary

A method for processing an image signal, an image signal processor, and an image sensor chip are disclosed. A method for processing an image signal includes generating Bayer order status information indicating whether a Bayer order of a Bayer pattern image has been changed, based on translation information of gyro information, performing translation correction about the Bayer pattern image using the translation information, and performing interpolation about the Bayer pattern image in which the translation correction has been performed, based on the Bayer order status information.