Image Processing Apparatus Pixel Type Encoding

Solution Overview

Problem

The pixel value of image plane phase difference detection pixels differs significantly from normal pixels due to shading, leading to increased prediction errors during encoding and decoding, which can degrade encoding efficiency and picture quality.

Innovation Solution

An image processing apparatus and method that encodes and decodes image data based on the type of pixel, with specific correction methods for image plane phase difference detection pixels, such as multiplication or division by a fixed value based on shading rates, to reduce prediction errors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If image plane phase difference detection pixels are used as prediction pixels for normal pixels during encoding, then phase difference detection functionality is achieved, but prediction error increases due to significant pixel value differences caused by shading

Engineering Contradiction:

Improvephase difference detection accuracyVSAvoidprediction error

Core Design Contradiction:

ReliabilityVSManufacturing precision

Solution Approach 1:

The patent segments the encoding process into two distinct paths: one for normal pixels and another for image plane phase difference detection pixels. This segmentation allows each pixel type to be encoded using appropriate prediction methods, preventing the prediction error that would occur if phase difference detection pixels were used to predict normal pixels.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent applies different encoding strategies to different pixel types based on their local characteristics. Normal pixels use standard prediction methods, while image plane phase difference detection pixels use correction methods that account for their shaded structure. This local quality approach ensures optimal encoding for each pixel type without compromising the other.

Inventive Principle:

Principle #3Local quality

2Ease of operation

If normal pixel prediction values are used for image plane phase difference detection pixels, then encoding simplicity is maintained, but prediction error increases due to value mismatches

Engineering Contradiction:

Improveencoding simplicityVSAvoidprediction error

Core Design Contradiction:

Ease of operationVSManufacturing precision

Solution Approach 1:

The patent applies different encoding strategies to different pixel types based on their local characteristics. Normal pixels use standard prediction methods, while image plane phase difference detection pixels use correction methods that account for their shaded structure. This local quality approach ensures optimal encoding for each pixel type without compromising the other.

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

The patent changes the prediction parameter (pixel value) based on the pixel type. For image plane phase difference detection pixels, it applies correction values or multiplies by correction factors to adjust the prediction value to match the actual pixel characteristics, thereby reducing prediction error while maintaining encoding efficiency.

Inventive Principle:

Principle #35Parameter changes

3Device complexity

If uniform encoding method is applied to all pixels, then device complexity is minimized, but encoding efficiency deteriorates for phase difference detection pixels due to pixel type differences

Engineering Contradiction:

Improveencoding method uniformityVSAvoidencoding efficiency

Core Design Contradiction:

Device complexityVSProductivity

Solution Approach 1:

The patent segments the encoding process into two distinct paths: one for normal pixels and another for image plane phase difference detection pixels. This segmentation allows each pixel type to be encoded using appropriate prediction methods, preventing the prediction error that would occur if phase difference detection pixels were used to predict normal pixels.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent changes the prediction parameter (pixel value) based on the pixel type. For image plane phase difference detection pixels, it applies correction values or multiplies by correction factors to adjust the prediction value to match the actual pixel characteristics, thereby reducing prediction error while maintaining encoding efficiency.

Inventive Principle:

Principle #35Parameter changes

Data Source

PatentUS11935212B2Image processing apparatus and method

Publication Date: 2024.03.19 SONY GROUP CORP

AI summary

The present disclosure relates to an image processing apparatus and method that make it possible to suppress increase of a prediction error. Image data is encoded by a method according to a type of pixel. For example, image data is encoded by a method according to whether the pixel is an image plane phase difference detection pixel or a normal pixel. Further, encoded data of image data is decoded by a method according to a type of pixel. For example, encoded data is decoded by a method according to whether the image is an image plane phase difference detection pixel or a normal pixel. The present technology can be applied, for example, to an image processing apparatus, an image encoding apparatus, an image decoding apparatus, an imaging device, an imaging apparatus, or the like.