Self-Referencing B-Frames for Interlaced Motion Prediction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video compression techniques, such as those in Windows Media Video and international standards like H.262, face challenges in accurately predicting motion vectors for macroblocks of interlaced video frames, leading to inefficiencies in bit rate and quality trade-offs.

Innovation Solution

The implementation of self-referencing frames and advanced motion vector prediction techniques, including the use of two-reference field interlaced P-fields and B-fields, where a second B-field references the first B-field for prediction, and the use of 4MV coding in specific prediction modes, to enhance prediction accuracy and scalability.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional motion vector prediction techniques are used for interlaced video frames, then device complexity is reduced, but prediction accuracy and rate/distortion performance deteriorate

Engineering Contradiction:
Improveprediction accuracyVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the prediction process into multiple reference fields (first reference field and second reference field) and applies different prediction modes (forward prediction, backward prediction, and bi-directional prediction) to different macroblocks within the same frame. This segmentation allows the system to achieve high prediction accuracy for various motion types while maintaining manageable device complexity through modular processing.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements dynamic prediction mode selection where the encoder chooses between forward prediction, backward prediction, and bi-directional prediction modes based on the actual motion characteristics of each macroblock. This dynamic adaptation enables the system to optimize prediction accuracy for each local region while keeping the overall device complexity reasonable through context-based decision making.

Inventive Principle:
Principle #15Dynamics

2Productivity

If advanced motion vector prediction techniques are used, then rate/distortion performance improves, but computational resources and CPU requirements increase

Engineering Contradiction:
Improverate/distortion performanceVSAvoidCPU resources
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent applies different prediction techniques with varying computational complexity to different regions of the video frame based on local motion characteristics. High-complexity bi-directional prediction is applied only where needed (high motion areas), while simpler prediction modes are used in low-motion areas, optimizing the rate/distortion performance without unnecessarily consuming CPU resources across the entire frame.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent changes the prediction parameters (reference field selection, prediction mode) based on local motion analysis of each macroblock. By adapting these parameters locally rather than applying a uniform high-complexity approach to the entire frame, the system achieves improved rate/distortion performance while controlling overall computational resource consumption.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If self-referencing frames with multiple reference fields are used, then prediction accuracy for high motion scenarios improves, but processing complexity increases

Engineering Contradiction:
Improveprediction accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent divides the frame into multiple macroblocks and applies different prediction modes (forward, backward, bi-directional) to different segments based on their motion characteristics. This segmentation allows the system to handle high motion scenarios with appropriate prediction accuracy while managing processing complexity through localized processing strategies.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements dynamic selection of reference fields and prediction modes based on the motion characteristics of each macroblock. This dynamic approach enables the system to achieve high prediction accuracy for high motion areas by selecting appropriate reference fields, while maintaining reasonable processing complexity through context-adaptive decision making.

Inventive Principle:
Principle #15Dynamics

4Loss of information

If conventional compression techniques are used, then device complexity is low, but bit rate efficiency and quality deteriorate

Engineering Contradiction:
Improvebit rate efficiencyVSAvoiddevice complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent segments the video frame into multiple macroblocks and applies different prediction modes to different segments based on their motion characteristics. This segmentation enables more efficient bit rate utilization by matching prediction accuracy to actual motion needs, improving overall compression efficiency without requiring uniformly high complexity across the entire processing system.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes prediction parameters (reference field selection, prediction mode) based on local motion analysis, enabling more efficient use of bit rate by allocating higher prediction accuracy only where motion requires it. This parameter adaptation improves bit rate efficiency while keeping device complexity manageable through context-based processing.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS7680185B2Self-referencing bi-directionally predicted frames
Publication Date: 2010.03.16 MICROSOFT TECHNOLOGY LICENSING LLC
  • US7680185B2 patent drawing
  • US7680185B2 patent drawing
  • US7680185B2 patent drawing

AI summary

An encoder/decoder uses “self-referencing” frames. For example, a second B-field in a current frame references the first B-field from the current frame in motion compensated prediction. Allowing the first B-field in a frame to act as a reference for the second B-field in the frame allows more accurate prediction of the second B-field, while also preserving the temporal scalability benefits of having B-fields in the current frame.