Image Encoder Adaptive Prediction Mode Selection for 4:4:4 Video
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing high 4:4:4 profile in video encoding systems is not optimized for encoding images where all color components equally contribute to the structural representation, as it simply expands the intra-prediction modes from the 4:2:0 format, leading to suboptimal prediction efficiency.
Innovation Solution
An image encoder that selectively uses common or separate prediction modes for color components, allowing flexible selection of intra- and inter-prediction modes based on control signals and multiplexing appropriate information in the bit stream, enabling adaptive encoding even with diverse color space definitions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the high 4:4:4 profile simply expands intra-prediction modes from the 4:2:0 format, then compatibility with existing standards is maintained, but prediction efficiency for 4:4:4 format images is suboptimal
Solution Approach 1:
The patent segments the prediction mode selection into separate processes for luminance and color difference components. The encoder independently selects intra-prediction modes for Y component and CbCr components, rather than using a unified mode selection approach. This segmentation allows optimal prediction modes to be chosen for each component type, improving overall prediction efficiency while maintaining standard compatibility.
Solution Approach 2:
The patent implements dynamic mode selection where the encoder adaptively chooses between different prediction modes (intra, inter, skip modes) and between separate or common mode signaling based on the actual content characteristics. This dynamic approach allows the system to optimize prediction efficiency for each macroblock and each color component independently, rather than using a static expanded mode set from 4:2:0 format.
2Productivity
If separate prediction modes are used for luminance and color difference components, then prediction efficiency is improved, but encoding complexity and bit stream overhead increase
Solution Approach 1:
The patent dynamically adjusts the level of separate mode signaling based on content characteristics. When color difference components benefit significantly from separate prediction, the encoder uses separate mode signaling. When the benefit is minimal, it falls back to common mode signaling. This dynamic adaptation optimizes the balance between prediction efficiency and encoding complexity.
Solution Approach 2:
The patent changes the parameter of mode signaling granularity based on the actual prediction performance needs. Instead of always using fine-grained separate mode signaling for all components, the system adapts the signaling parameter to match the content requirements, reducing unnecessary complexity while maintaining prediction efficiency where needed.
3Device complexity
If common prediction modes are used for all color components, then encoding complexity is reduced, but prediction efficiency for 4:4:4 format images deteriorates
Solution Approach 1:
The patent segments the prediction processing into distinct pathways for luminance and color difference components. This segmentation allows the system to apply appropriate prediction strategies to each component type, improving prediction efficiency for 4:4:4 format images where color components contribute equally to structural representation, while managing encoding complexity through organized separate processing.
Solution Approach 2:
The patent changes the prediction mode parameter from a unified approach to a component-specific approach for 4:4:4 format. By adjusting the mode selection parameters independently for each color component, the system achieves optimal prediction efficiency tailored to the characteristics of 4:4:4 images where all components are equally important.
Data Source
AI summary
An image encoder including: a predicted-image generating unit that generates a predicted image in accordance with a plurality of prediction modes indicating predicted-image generating methods; a prediction-mode judging unit that evaluates prediction efficiency of a predicted image outputted from the predicted-image generating unit to judge a predetermined prediction mode; and an encoding unit that subjects an output of the prediction-mode judging unit to variable-length encoding. The prediction-mode judging unit judges, on the basis of a predetermined control signal, which one of a common prediction mode and a separate prediction mode is used for respective color components forming the input image signal, and multiplexes information on the control signal on a bit stream, multiplexes, when the common prediction mode is used, common prediction mode information on the bit stream, and multiplexes, when the common prediction mode is not used, prediction mode information for each of the color components on the bit stream.