4:4:4 Video Encoding Intra Prediction Mode Selection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video encoding standards, such as MPEG and ITU-T H.264, are not optimized for the 4:4:4 format, where all color components contribute equally to image structure, leading to suboptimal compression efficiency due to limitations in motion compensation prediction and intra prediction modes.

Innovation Solution

The development of an encoding device and decoding device that adaptively select intra prediction modes for each color component in the 4:4:4 format, using a spatial prediction unit to evaluate prediction efficiencies and switch between different prediction modes based on color space definitions, allowing for optimal encoding and decoding processes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If motion compensation prediction uses common information for all color components in 4:4:4 format, then device complexity is reduced, but compression efficiency deteriorates

Engineering Contradiction:
Improveprediction information structureVSAvoidcompression efficiency
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The patent segments the prediction information structure by component type. It divides color components into luminance (Y) and chrominance (Cb, Cr) groups, allowing separate prediction mode handling. This segmentation enables optimized prediction for each component group while maintaining manageable device complexity through structured organization.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces dynamic selection of prediction modes based on color space definition and component characteristics. The system can adaptively choose between intra prediction modes (Planar, DC, Vertical, Horizontal) and inter prediction modes, with the ability to switch between common and separate prediction approaches based on the specific encoding context and color space being used.

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If intra prediction mode is extended simply from 4:2:0 format for 4:4:4 format, then compatibility is maintained, but manufacturing precision of encoding optimization deteriorates

Engineering Contradiction:
Improveformat compatibilityVSAvoidencoding optimization precision
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent applies local quality by tailoring prediction mode selection and processing to the specific characteristics of each color component and color space. Instead of uniform treatment, the system adjusts prediction strategies based on the local requirements of luminance versus chrominance components and the specific color space definition (RGB, YCbCr, etc.), achieving precise optimization for each local context while maintaining overall compatibility.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent utilizes parameter changes by adjusting prediction mode selection, block size, and processing parameters based on the color space definition and component type. The system can change operational parameters dynamically to optimize encoding for 4:4:4 format specifically, rather than being constrained to fixed parameters designed for 4:2:0 format, thereby achieving both compatibility and precision.

Inventive Principle:
Principle #35Parameter changes

3Device complexity

If one luminance component is treated as representative for all components in inter prediction, then device complexity is reduced, but measurement precision of color component contribution deteriorates

Engineering Contradiction:
Improveprediction information structureVSAvoidcolor component contribution accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent segments color components into distinct groups (luminance Y and chrominance Cb, Cr) with different prediction handling. This segmentation allows the system to recognize and process the unequal contribution of different components to image structure, treating luminance and chrominance components with appropriate precision while maintaining manageable complexity through structured organization.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces dynamic adaptation in inter prediction by allowing separate reference image and motion vector information for luminance and chrominance components when beneficial. The system can dynamically switch between using common prediction information (when components correlate highly) and separate prediction information (when components have distinct motion characteristics), optimizing measurement precision adaptively.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP2169961B1Image encoder and image decoder
Publication Date: 2014.03.05 MITSUBISHI ELECTRIC CORP
  • EP2169961B1 patent drawingFigure 1
  • EP2169961B1 patent drawingFigure 2
  • EP2169961B1 patent drawingFigure 3

AI summary

An encoding device includes a color component separating unit for separating an input bit stream for the respective color components, a block dividing unit for dividing an input color component signal into blocks to generate a signal of an encoding unit area, a predicted image generating unit for generating a predicted image for the signal, a determining unit for determining a prediction mode used for encoding according to a prediction efficiency of the predicted image, a prediction error encoding unit for encoding a difference between the predicted image corresponding to the prediction mode determined by the determining unit and the input color component signal, and an encoding unit for variable length-coding the prediction mode, an output from the prediction error encoding unit, and a color component identification flag indicating the color component to which the input bit stream belongs as a result of the color component separation.