Residue Prediction in Video Coding Using Pseudo-Residues
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies do not effectively utilize residual correlations between neighboring blocks to improve coding efficiency or video quality, despite research indicating potential in combining intra-frame and inter-frame prediction methods.
Innovation Solution
A video processing apparatus and method that spatially partitions video frames into blocks, using a motion estimation/compensation unit, pseudo-residue generating unit, residue-predicting unit, and post-processing unit to derive pseudo residues and second-order residues for predicting current block residues, thereby enhancing encoding efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If intra-frame prediction is used to remove spatial correlations, then coding efficiency is improved, but complexity increases and it only works well for certain scene types
Solution Approach 1:
The patent combines intra-frame prediction and inter-frame prediction into a hybrid prediction mechanism. The prediction unit can select from multiple prediction modes (intra-mode, inter-mode, and hybrid-mode) depending on the scene characteristics, merging the advantages of both prediction methods to improve coding efficiency while adapting to different video content types.
Solution Approach 2:
The prediction mode selection is dynamic rather than fixed. The system automatically switches between intra-frame prediction, inter-frame prediction, or hybrid prediction based on the current video frame characteristics, motion vectors, and scene complexity, allowing the prediction mechanism to adapt its complexity level to the specific coding task.
2Productivity
If motion compensation is used to reduce temporal redundancies, then coding efficiency is improved, but residual correlations between neighboring blocks are not utilized
Solution Approach 1:
The patent extracts and utilizes the residual correlation information that was previously discarded or ignored in conventional motion compensation. By calculating the difference between motion-compensated blocks and actual blocks, the system recovers residual correlations between neighboring blocks and uses this information for enhanced prediction, thereby reducing information loss while maintaining compression efficiency.
Solution Approach 2:
The residual prediction mechanism acts as an intermediary between motion compensation and final reconstruction. It processes the residual signals from motion-compensated blocks to generate additional prediction information that is then combined with the motion-compensated output, effectively bridging the gap between simple motion compensation and optimal reconstruction.
3Ease of manufacture
If conventional prediction methods are used, then processing is simple, but bit-rate savings are limited
Solution Approach 1:
The patent segments the prediction process into multiple stages: motion compensation prediction, residual calculation, residual prediction, and final reconstruction. Each stage processes specific components of the video data independently, allowing the system to maintain processing simplicity at each stage while achieving significant bit-rate savings through the cumulative effect of all stages working together.
Data Source
AI summary
A video processing apparatus with residue prediction includes a motion estimation/compensation unit to determine a matching block of a reference video frame, obtain a motion vector of a current block of a current video frame that is related to the matching block, and acquire neighboring reconstructed pixels adjacent to the current block and corresponding pixels adjacent to the matching block with the motion vector alignment. Additionally, a pseudo-residue generating unit is included and constructs pseudo residues according to the neighboring reconstructed pixels and the corresponding pixels, an arithmetic unit is included and generates first-order residues by subtracting the matching block from the current block, and a residue-predicting unit is included and derives second-order residues and corresponding information according to the pseudo residues and the first-order residues. Moreover, a post-processing unit is included and derives a reconstructed current block according to the second-order residues and its corresponding information.