Video Encoding Mode Decisions Using Down-Scaled Texture Complexity

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

H.264-based video transcoding with spatial resolution conversion is complex due to time-consuming motion compensated prediction and exhaustive rate distortion optimization, particularly in encoding mode decision processes.

Innovation Solution

A mode decision algorithm based on mode correlation is implemented, utilizing prediction mode information from original full-scale scenes to predict encoding modes for down-scaled scenes, reducing the need for exhaustive motion search and optimizing encoding time while maintaining video quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If exhaustive rate distortion optimization is performed for each macroblock to determine encoding mode decisions, then encoding quality is improved, but encoding time increases significantly

Engineering Contradiction:
Improveencoding qualityVSAvoidencoding time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by using mode correlation information from the full-scale frame to pre-determine prediction modes for down-scaled macroblocks before performing rate distortion optimization. This preliminary determination narrows down the search space, allowing the encoder to focus computational resources only on the most promising modes rather than exhaustively evaluating all possible modes, thus reducing encoding time while maintaining quality.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements partial action by selectively applying rate distortion optimization only to macroblocks where it is most beneficial, rather than uniformly applying it to all macroblocks. By using mode correlation to identify which macroblocks require detailed optimization versus those that can use simplified decision-making, the system achieves high encoding quality for critical regions while reducing overall computational burden.

Inventive Principle:
Principle #16Partial or excessive action

2Measurement precision

If motion compensated prediction with complex motion search algorithms is used, then prediction accuracy is improved, but processing complexity increases

Engineering Contradiction:
Improveprediction accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses preliminary action by determining prediction modes for down-scaled macroblocks based on mode correlation with the full-scale frame before performing detailed motion search. This preliminary step provides a good initial estimate that guides the motion compensated prediction process, allowing the system to achieve high prediction accuracy with reduced search complexity by focusing computational effort on refining the pre-determined modes rather than searching all possible modes.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If all supported encoding modes are considered for rate distortion optimization, then mode decision accuracy is improved, but computational time increases

Engineering Contradiction:
Improvemode decision accuracyVSAvoidcomputational time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies partial action by using mode correlation to identify a subset of promising encoding modes for each down-scaled macroblock based on the corresponding full-scale macroblock's mode. Instead of evaluating all supported encoding modes, the system focuses rate distortion optimization on the most likely candidate modes, achieving high mode decision accuracy while significantly reducing computational time by avoiding evaluation of unlikely modes.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS9609358B2Performing video encoding mode decisions based on down-scaled macroblock texture complexity
Publication Date: 2017.03.28 ATI TECHNOLOGIES ULC
  • US9609358B2 patent drawing
  • US9609358B2 patent drawing
  • US9609358B2 patent drawing

AI summary

A method and apparatus are described for performing video encoding mode decisions in a video transcoding system. A down-scaled frame may be received that includes at least one macroblock. The down-scaled frame may be associated with a full-scale frame having a plurality of macroblocks that have been downsampled. A weighting factor and a distance measure factor may be determined for each of the macroblocks in the full-scale frame. Predicted blocks may be generated based on the weighting and distance measure factors.