Unified Intra Block Copy and Inter Prediction for Simpler Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The implementation of intra block copy (BC) prediction mode in HEVC extensions is complex and does not justify the added complexity due to its integration with regular intra and inter prediction modes, leading to inefficiencies in encoding and decoding processes.
Innovation Solution
Unified intra BC and inter prediction modes are introduced, where intra BC prediction uses inter prediction mode syntax, semantics, and coding/decoding processes, allowing reuse of existing tools for simplified implementation by enabling intra BC prediction with the current picture as a reference picture.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If intra block copy prediction mode is integrated with regular intra and inter prediction modes, then prediction functionality is enhanced, but implementation complexity increases significantly
Solution Approach 1:
The patent merges intra block copy prediction mode with inter prediction mode by using the same prediction structure and syntax. The current picture is treated as a reference picture for intra BC prediction, allowing reuse of inter prediction tools and processes. This unification combines multiple prediction functionalities into a single coherent framework, enhancing adaptability while controlling complexity through shared implementation resources.
Solution Approach 2:
The patent implements universality by enabling the current picture to serve dual purposes: as the picture being encoded and as a reference picture for intra block copy prediction. The inter prediction mode syntax and decoding processes are made universal, serving both traditional inter-picture prediction and intra-block copy prediction functions. This multi-functionality reduces the need for separate dedicated implementations.
2Device complexity
If intra block copy prediction mode is implemented separately from inter prediction mode, then implementation is simpler, but encoding and decoding efficiency decreases
Solution Approach 1:
The patent combines intra block copy prediction with inter prediction mode implementation, allowing the use of shared tools, syntax, and decoding processes. This merging eliminates redundant implementation efforts and enables efficient resource utilization during encoding and decoding operations, thereby improving productivity while maintaining reasonable implementation simplicity through code reuse.
Solution Approach 2:
The patent makes the inter prediction mode universal by enabling it to handle both traditional inter-picture prediction and intra-block copy prediction tasks. The same prediction structure, syntax elements, and decoding algorithms serve multiple functions, improving encoding and decoding efficiency through shared computational resources and streamlined processing paths.
3Ease of manufacture
If the current picture is used as a reference picture for intra BC prediction, then intra BC prediction can reuse inter prediction tools, but the reference picture management becomes more complex
Solution Approach 1:
The patent merges the handling of current picture as both the picture being encoded and as a reference picture for intra block copy prediction. By treating the current picture as a valid reference picture with appropriate constraints, the system can reuse inter prediction tools and processes. The reference picture management is simplified through this unified approach, as the same management mechanisms apply to both traditional reference pictures and the current picture.
Data Source
AI summary
Innovations in unified intra block copy (“BC”) and inter prediction modes are presented. In some example implementations, bitstream syntax, semantics of syntax elements and many coding/decoding processes for inter prediction mode are reused or slightly modified to enable intra BC prediction for blocks of a frame. For example, to provide intra BC prediction for a current block of a current picture, a motion compensation process applies a motion vector that indicates a displacement within the current picture, with the current picture being used as a reference picture for the motion compensation process. With this unification of syntax, semantics and coding/decoding processes, various coding/decoding tools designed for inter prediction mode, such as advanced motion vector prediction, merge mode and skip mode, can also be applied when intra BC prediction is used, which simplifies implementation of intra BC prediction.