Temporal Intra Prediction with Motion-Compensated Reference Samples
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video encoding technologies face challenges in achieving high compression efficiency due to limitations in intra prediction modes, particularly for inter slices far from reference frames, leading to suboptimal rate-distortion compromise and increased decoder complexity.
Innovation Solution
Introduce temporal intra prediction that utilizes motion compensation to derive reference samples from a reference frame, enhancing intra prediction by incorporating motion information and expanding prediction directions, including negative angles and full planar modes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional intra prediction modes are used for inter slices far from reference frames, then spatial redundancy is exploited, but coding efficiency deteriorates and rate-distortion compromise becomes suboptimal
Solution Approach 1:
The patent merges temporal prediction (using motion compensation from reference frames) with intra prediction (spatial prediction from neighboring blocks) to create a hybrid prediction mode. This combination allows the encoder to leverage both temporal and spatial redundancy, improving coding efficiency for inter slices far from reference frames while maintaining compression quality.
Solution Approach 2:
The patent creates a universal prediction framework that can adaptively switch between traditional intra prediction and temporal intra prediction based on the distance from reference frames. This multi-functional approach allows the same prediction mechanism to serve both spatial and temporal prediction needs, optimizing performance across different slice types and distances.
2Adaptability or versatility
If more intra prediction modes are introduced to improve compression efficiency, then coding flexibility increases, but decoder complexity increases
Solution Approach 1:
The patent introduces dynamic prediction modes where the prediction direction and reference frame selection are adaptively determined based on motion information and slice distance. Rather than providing a fixed large number of prediction modes, the system dynamically adjusts the prediction approach, maintaining flexibility while controlling decoder complexity through conditional logic.
Solution Approach 2:
The patent changes key parameters such as prediction direction angles (including negative angles) and reference frame indices based on motion vector analysis. By dynamically adjusting these parameters rather than providing exhaustive mode options, the system achieves adaptability without proportionally increasing decoder complexity.
3Productivity
If temporal intra prediction is used to leverage motion compensation, then coding efficiency improves, but processing complexity increases
Solution Approach 1:
The patent performs motion compensation and reference frame selection in advance during the encoding phase, storing the results for use during decoding. This preliminary action reduces the processing complexity during actual decoding by pre-computing the temporal prediction components, allowing the decoder to simply retrieve and apply the pre-processed motion-compensated reference samples.
Data Source
AI summary
Intra prediction samples are determined for encoding in video encoders and decoding in video decoders using one of several embodiments. In at least one embodiment, motion information is derived to determine reference samples to use from a reference frame. The reference samples are used in an intra prediction mode to determined a prediction samples. The reference samples are used in encoding or decoding. In at least one embodiment, one of several motion models can be used to extract the motion information. The motion model, intra mode, or reference frame can be signaled from an encoder to a decoder. The signaling can use an index. The global motion model is computed at an encoder and sent in a slice header or a picture header to a corresponding decoder. In at least one embodiment, a different reference is used for a reference frame.