Reference Frame Selection for Video Codec Error Resilience
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video codecs using multiple reference frames (MRF) suffer from increased error propagation and reduced error resilience in network environments, leading to deteriorated display quality due to lossy data transmission.
Innovation Solution
A method for selecting a reference frame that involves individual motion estimation for each macroblock, calculating the matching degree with intra-coded areas, and selecting the motion vector with the highest refresh ratio to minimize error propagation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If multiple reference frames are used for motion estimation, then compression efficiency is improved, but error propagation increases and error resilience deteriorates
Solution Approach 1:
The patent dynamically adjusts the reference frame selection based on the refresh status of macroblocks. The system transitions between using multiple reference frames (for compression efficiency) and single reference frame (for error resilience) depending on whether macroblocks are in refresh mode or not, creating a dynamic adaptation to local error conditions
Solution Approach 2:
The patent applies different reference frame strategies to different regions of the video frame based on their refresh status. Refreshed macroblocks use one reference frame strategy while non-refreshed macroblocks use another, allowing local optimization of error resilience where needed while maintaining compression efficiency in other areas
2Measurement precision
If motion estimation references arbitrary frames between Ft-n and Ft+n, then background estimation accuracy improves, but error propagation to subsequent frames increases
Solution Approach 1:
The patent preemptively prevents error propagation by selecting reference frames based on their refresh status before motion compensation is performed. By checking whether reference macroblocks are refreshed and avoiding reference to non-refreshed areas, the system prevents errors from propagating to subsequent frames before they can occur
Solution Approach 2:
The patent introduces refresh status as an intermediary criterion between motion estimation and motion compensation. This intermediate check determines whether a reference frame should be used, acting as a mediator that filters out potentially error-prone reference frames while allowing accurate background estimation from safe references
Data Source
AI summary
The present invention relates to a reference frame selection technique for an error resilience of video codec using multiple reference frames. The reference frame selection technique for an error resilience of video codec using multiple reference frames according to the present invention comprises the steps of: performing a motion estimation individually in each of the multiple reference frames so as to search a reference macroblock of the macroblock to be coded; checking the degree of match between the reference macroblock region found by the motion estimation and the intra-coded macroblock of the reference frame; and selecting the motion vector (MV) of the reference macroblock which is relatively best matched to the intra-coded macroblock of the reference frame from among the reference macroblocks found in each of the multiple reference frames.