Pixel Prediction for Video Coding Using Local Structure Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video encoding and decoding methods face challenges in achieving accurate prediction of video blocks while maintaining low bit capacity, as local adaptive filters are difficult to implement due to the high cost of coding filter coefficients and template matching errors can propagate from previously decoded regions.
Innovation Solution
The method involves disassembling video frames into blocks, generating predicted blocks from reconstructed pixels, and creating a local structure of reconstructed pixels within the predicted block's region for alignment, which allows for improved prediction without increasing bit capacity, enabling better robustness against communication errors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If local adaptive filters are used for prediction, then prediction accuracy is improved, but bit capacity increases due to coding filter coefficients
Solution Approach 1:
The invention extracts only the essential structural information from the prediction process by creating a local structure of reconstructed pixels within the predicted block region. This local structure captures the essential spatial relationships without requiring full filter coefficients, thereby maintaining prediction accuracy while significantly reducing the bit capacity needed for encoding the prediction parameters.
Solution Approach 2:
The invention applies local quality by creating a local structure specifically within the region of the predicted block rather than applying global filtering. This allows the prediction to adapt to local image characteristics and structures without requiring complex global filter coefficients, thus improving prediction accuracy for local regions while keeping the overall bit capacity low.
2Measurement precision
If template matching is used for prediction, then prediction accuracy is improved, but errors propagate from previously decoded regions
Solution Approach 1:
The invention segments the prediction process by creating a local structure within the predicted block region rather than relying on external template matching. This segmentation isolates the prediction process from previously decoded regions, preventing error propagation while maintaining the ability to capture local image structures for accurate prediction.
Solution Approach 2:
The local structure of reconstructed pixels acts as an intermediary between the previously decoded pixels and the predicted block. Instead of directly copying or matching templates from external regions (which can propagate errors), the local structure serves as a localized mediator that captures essential spatial relationships while being self-contained within the predicted block region, thus preventing error propagation.
3Measurement precision
If more local adaptation of prediction is implemented, then prediction accuracy is improved, but implementation complexity increases
Solution Approach 1:
The invention performs preliminary action by creating the local structure of reconstructed pixels before the actual prediction process. This local structure is prepared in advance within the predicted block region, capturing the essential spatial relationships that will be used for prediction. By doing this preparation work beforehand, the actual prediction step becomes simpler and more efficient, reducing overall implementation complexity while maintaining high prediction accuracy.
Data Source
AI summary
A method of encoding an input video frame into an encoded video frame comprises the steps of disassembling the input video frame into a plurality of blocks of pixels. For each block being a current block, the method further comprises generating a corresponding predicted block from already reconstructed pixels, generating a residual block by subtracting the predicted block from the current block, generating a reconstructed block from the residual block and the predicted block, and generating the encoded video frame from the residual block The method further entails creating a local structure of reconstructed pixels in a region of the predicted block and aligning the predicted block with the local structure to produce an aligned predicted block, wherein the aligned predicted block is used in the steps of generating the residual block and generating the corresponding reconstructed block.