Image Processing Apparatus Cutout Region Hand Shake Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Electronic type hand shake correcting systems in imaging devices consume excessive power and processing resources due to unnecessary image processing across the entire valid pixel region, limiting frame rates and increasing power consumption.

Innovation Solution

An image processing apparatus that determines a cutout region based on motion information and performs image processing only within this effective pixel region, reducing unnecessary processing and power consumption by separating former and latter stage processing within the sensor module.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If image processing is performed across the entire valid pixel region for hand shake correction, then hand shake correction effectiveness is improved, but power consumption and processing load increase excessively

Engineering Contradiction:
Improvehand shake correction effectivenessVSAvoidpower consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent extracts only the effective pixel region that actually contains image information from the entire valid pixel region. By performing hand shake correction processing only on this extracted effective region rather than the full sensor output, the processing load and power consumption are significantly reduced while maintaining correction effectiveness for the actual image content.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies different processing strategies to different regions of the sensor output. The effective pixel region receives full hand shake correction processing, while the invalid region (containing no image information) is excluded from processing. This localized approach optimizes resource allocation by applying computational effort only where needed.

Inventive Principle:
Principle #3Local quality

2Reliability

If image processing is performed across the entire valid pixel region, then hand shake correction completeness is improved, but frame rate is limited due to processing load

Engineering Contradiction:
Improvehand shake correction completenessVSAvoidframe rate
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent extracts and processes only the effective pixel region containing actual image data, excluding invalid regions from the processing pipeline. This reduction in processing volume enables higher frame rates by decreasing the computational burden while ensuring complete hand shake correction for all pixels that actually contribute to the final image.

Inventive Principle:
Principle #2Taking out (Extraction)

3Manufacturing precision

If full pixel region processing is performed, then processing thoroughness is improved, but unnecessary processing of invalid regions increases power consumption

Engineering Contradiction:
Improveprocessing thoroughnessVSAvoidenergy waste
Core Design Contradiction:
Manufacturing precisionVSLoss of energy

Solution Approach 1:

The patent extracts the effective pixel region from the full sensor output and performs processing only on this extracted subset. This eliminates energy waste associated with processing invalid regions that contain no image information, while maintaining thorough processing of all relevant pixels.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent implements region-specific processing where the effective pixel region receives complete hand shake correction processing while invalid regions are excluded. This local quality approach ensures processing thoroughness is applied only where it matters, eliminating unnecessary energy consumption.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11368620B2Image processing apparatus, image processing method, and electronic device
Publication Date: 2022.06.21 SONY GROUP CORP
  • US11368620B2 patent drawing
  • US11368620B2 patent drawing
  • US11368620B2 patent drawing

AI summary

There is provided an image processing apparatus that improves the efficiency of hand shake correction processing by an electronic type hand shake correcting system. The image processing apparatus including a memory section that memorizes a pixel signal output from an imaging element, a region determining section that determines a cutout region of the pixel signal memorized in the memory section on a basis of motion information of the imaging element, and an image processing section that executes image processing with regard to image quality for a pixel signal in the cutout region determined by the region determining section.