Image Processing Apparatus Pixel Decimation Power Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies face challenges in reducing electric power consumption while maintaining image quality, as decimation methods can lead to loss of high-frequency components and information, and selecting operation modes based on pixel information only partially addresses power reduction.

Innovation Solution

An image processing apparatus that performs interpolation on decimated pixels, determines whether pixels are decimated or non-decimated based on calculated feature values, and controls signal generation to stop processing of decimated pixels, thereby reducing power consumption without degrading image quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Use of energy by moving object

If decimation is performed by summing multiple pixels to generate one pixel, then electric power consumption is reduced, but high frequency components are lost and image quality degrades

Engineering Contradiction:
Improveelectric power consumptionVSAvoidimage quality
Core Design Contradiction:
Use of energy by moving objectVSManufacturing precision

Solution Approach 1:

The image sensor pixels are segmented into two types: first pixels that generate image signals for high-definition imaging, and second pixels that do not generate image signals but contribute to reducing power consumption. This segmentation allows the system to process only necessary pixels while maintaining image quality in critical regions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different regions of the image sensor are assigned different functions based on local quality requirements. Regions requiring high image quality (first pixels) maintain full signal generation capability, while other regions (second pixels) are optimized for power reduction. This local differentiation resolves the contradiction between overall power reduction and localized image quality maintenance.

Inventive Principle:
Principle #3Local quality

2Use of energy by moving object

If pixels are decimated at predetermined intervals, then electric power consumption is reduced, but information of decimated pixels is lost

Engineering Contradiction:
Improveelectric power consumptionVSAvoidpixel information
Core Design Contradiction:
Use of energy by moving objectVSLoss of information

Solution Approach 1:

The pixel array is segmented into first pixels that maintain full information generation capability and second pixels that are decimated. By strategically positioning first pixels throughout the array rather than uniform decimation, the system preserves essential information while achieving power reduction in less critical areas.

Inventive Principle:
Principle #1Segmentation

3Loss of information

If A/D conversion process is performed on all pixels, then complete image information is maintained, but electric power consumption increases

Engineering Contradiction:
Improveimage information completenessVSAvoidelectric power consumption
Core Design Contradiction:
Loss of informationVSUse of energy by moving object

Solution Approach 1:

The A/D conversion process is segmented to apply only to first pixels that require full information processing, while second pixels bypass this energy-intensive conversion stage. This selective processing maintains complete image information where needed while significantly reducing overall power consumption from the A/D conversion subsystem.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Instead of performing A/D conversion on all pixels (excessive action), the system applies partial action by converting only the necessary first pixels. This partial processing approach maintains sufficient image information quality while avoiding the excessive power consumption of universal pixel conversion.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10075661B2Image processing apparatus, image processing method, and image capturing apparatus
Publication Date: 2018.09.11 SONY GROUP CORP
  • US10075661B2 patent drawing
  • US10075661B2 patent drawing
  • US10075661B2 patent drawing

AI summary

An interpolation processing unit 31 performs an interpolation process of a decimated pixel in an image signal. A signal generation pixel determination unit 32 calculates a feature value of a pixel of interest from the image signal to which the interpolation process is performed by the interpolation processing unit 31, and determines whether the pixel of interest is a decimated pixel or a non-decimated pixel on the basis of the calculated feature value, and generates signal generation pixel determination information indicating a determination result. A signal generation control unit 34 performs control to stop signal generation operation of the pixel that is determined to be the decimated pixel by the signal generation pixel determination information generated by the signal generation pixel determination unit 32, at a time of subsequent generation of an image signal. The degradation of image quality is prevented, and the electric power consumption is reduced, by performing decimation in a flat image region on the basis of a feature value.