B-Frame Fraction Coding for Variable Velocity Motion Modeling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional video compression techniques, such as those used in WMV8 and MPEG standards, face limitations in efficiently encoding and decoding bi-directionally predicted frames (B-frames) due to timestamp dependency and constant velocity assumptions, leading to increased bit rates and reduced flexibility in motion modeling.
Innovation Solution
The proposed solution involves fraction coding the temporal position of B-frames relative to their reference frames, eliminating timestamp dependency and allowing for variable velocity modeling, along with efficient motion vector scaling and interpolation filter selection, to reduce bit rates and improve encoding efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If timestamp dependency and constant velocity assumptions are used in conventional video compression techniques, then motion modeling is simplified, but bit rate increases and flexibility in motion modeling decreases
Solution Approach 1:
The patent changes the parameter representation from timestamp-based absolute time to fraction-based relative temporal position. By encoding the temporal position as a fraction between 0 and 1 representing the position between two reference frames, the system achieves variable velocity modeling without increasing bit rate, directly resolving the contradiction between modeling flexibility and bit rate efficiency
Solution Approach 2:
The patent introduces dynamic motion modeling by allowing different velocity profiles for different macroblocks within the same frame. Each macroblock can have its own motion vector and temporal position fraction, enabling adaptive motion compensation that matches actual motion patterns rather than assuming constant velocity across the entire frame
2Quantity of substance
If direct mode prediction is used in B-frames, then bit rate is reduced, but timestamp dependency increases system complexity
Solution Approach 1:
The patent extracts the timestamp dependency from the direct mode prediction process by removing the need for absolute timestamp calculations. Instead, the system uses relative temporal position fractions that are self-contained and do not require external timestamp information, reducing system complexity while maintaining bit rate efficiency
Solution Approach 2:
The patent introduces a fraction-based temporal position representation as an intermediary between the reference frames and the current B-frame. This intermediary eliminates the need for direct timestamp comparisons and complex time-based calculations, simplifying the prediction process while preserving the bit rate benefits of direct mode
3Quantity of substance
If conventional motion vector coding is used, then encoding is simpler, but motion vector coding efficiency decreases
Solution Approach 1:
The patent changes how motion vectors are coded by incorporating the fraction-based temporal position into the motion vector representation. Instead of coding absolute motion vectors independently, the system codes the temporal position fraction and uses it to derive motion vectors, improving coding efficiency through better exploitation of temporal redundancy
Solution Approach 2:
The patent performs preliminary calculation of the temporal position fraction before motion vector coding. By determining the fraction first and using it to guide the motion vector encoding process, the system achieves more efficient coding without requiring complex post-processing or iterative optimization
Data Source
AI summary
Techniques and tools for coding/decoding of video images, and in particular, B-frames, are described. In one aspect, a video encoder/decoder determines a fraction for a current image in a sequence. The fraction represents an estimated temporal distance position for the current image relative to an interval between a reference images for the current image. The video encoder/decoder processes the fraction along with a motion vector for a first reference image, resulting in a representation of motion (e.g., constant or variable velocity motion) in the current image. Other aspects are also described, including intra B-frames, forward and backward buffers for motion vector prediction, bitplane encoding of direct mode prediction information, multiple motion vector resolutions/interpolation filters for B-frames, proactive dropping of B-frames, and signaling of dropped predicted frames.