Image Processing Device Reference Pixel Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The increasing processing cost associated with building prediction functions in the Linear Model (LM) mode of HEVC, particularly due to the growing number of reference pixels, degrades the performance of encoding and decoding as the block size increases.

Innovation Solution

An image processing device and method that control the ratio of reference pixels to the block size, allowing for variable selection of reference pixels used in calculating coefficients for the prediction function, thereby mitigating the increase in processing cost.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the block size is increased to improve compression ratio, then the compression efficiency is improved, but the processing cost increases due to the growing number of reference pixels required for building prediction functions

Engineering Contradiction:
Improvecompression ratioVSAvoidprocessing cost
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the reference pixel set by introducing a classification mechanism that divides reference pixels into different groups based on their reliability or characteristics. This segmentation allows the system to process only relevant reference pixels for prediction function building, thereby reducing the overall processing cost while maintaining large block sizes for improved compression ratio.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by differentiating the treatment of reference pixels based on their local characteristics. Instead of uniformly processing all reference pixels, the system selectively applies different processing strategies to different groups of reference pixels, optimizing the balance between prediction accuracy and processing cost for each local region.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If the number of reference pixels is increased to improve prediction accuracy, then the prediction precision is improved, but the processing cost increases

Engineering Contradiction:
Improveprediction accuracyVSAvoidprocessing cost
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts only the necessary reference pixels from the complete set of available reference pixels. By identifying and removing redundant or less useful reference pixels, the system maintains prediction accuracy using a smaller, more efficient subset of reference pixels, thereby reducing processing cost without sacrificing prediction precision.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent implements partial action by using only the required portion of reference pixels rather than processing all available reference pixels. The classification mechanism determines the optimal number and type of reference pixels needed for accurate prediction, avoiding the excessive processing of unnecessary pixels while maintaining sufficient prediction accuracy.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10666945B2Image processing device and image processing method for decoding a block of an image
Publication Date: 2020.05.26 SONY GROUP CORP
  • US10666945B2 patent drawing
  • US10666945B2 patent drawing
  • US10666945B2 patent drawing

AI summary

Provided is an image processing apparatus including a decoding section that decodes a luminance component and a color difference component of a block inside a coding unit in an order of the luminance component and the color difference component in each block.