Partial Picture Replacement for Efficient Reference Frame Updates
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video compression standards, such as H.264 and H.265, require costly and complex procedures for updating entire frames when only a small portion of the background changes, leading to inefficient compression and increased computational complexity.
Innovation Solution
Implement partial updates to unavailable reference (UR) frames using explicit or implicit signaling at the decoder side, allowing only spatially co-located pixels within the UR frame to be updated based on the decoded current block, reducing the need for full frame updates.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If entire frame updates are performed in current video compression standards, then reference frame accuracy is improved, but computational complexity and processing cost increase significantly
Solution Approach 1:
The patent divides the reference frame update process into two segments: unavailable reference (UR) blocks that need updating and available reference blocks that remain unchanged. This segmentation allows the decoder to selectively update only the necessary portions of the reference frame rather than processing the entire frame, thereby reducing computational complexity while maintaining reference frame accuracy for the changed regions.
Solution Approach 2:
The patent applies partial action by performing updates only on the UR blocks where content changes have occurred, rather than updating the entire reference frame. The decoder identifies and processes only the specific blocks that require updating based on motion compensation results, avoiding unnecessary processing of unchanged areas and reducing overall computational burden.
2Measurement precision
If full frame updates are performed, then prediction accuracy is improved, but bit rate and header overhead increase
Solution Approach 1:
The patent extracts and processes only the necessary update information for UR blocks separately from the main frame data. By identifying and extracting only the blocks that require updating, the system transmits minimal additional information to the decoder, reducing bit rate and header overhead while maintaining prediction accuracy for the updated regions.
3Productivity
If complex update procedures are implemented for partial frame updates, then update efficiency is improved, but device complexity increases
Solution Approach 1:
The patent enables the decoder to autonomously identify and update UR blocks using locally available information and motion compensation techniques. The system performs self-service by determining which blocks need updating and executing the updates without requiring complex external coordination or additional processing infrastructure, thereby improving update efficiency while keeping device complexity manageable.
Data Source
AI summary
A method is provided for processing a video bitstream which includes a first picture and a sequence parameter set containing information indicating a mode is enabled in which a first area of a picture can be extracted and replaced by a second area of another picture. Using the mode, the first picture is modified by extracting the first area and replacing the extracted area with the second area from the other picture. The modified first picture is stored and a predictor is formed using the modified first picture as a reference picture. A block of a subsequent picture is decoded using the predictor.