Temporal Reference Picture Signaling in 3D Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing 3D-HEVC standard for video coding experiences inefficiencies in memory access due to frequent changes in reference pictures between slices, leading to performance bottlenecks in decoders, especially when scaling motion vectors to opposite directions and causing disruptions in the pipeline model.
Innovation Solution
Explicitly signaling the temporal reference picture for advanced residual prediction using syntax elements in the slice header to maintain a consistent reference picture across all slices within a picture, prohibiting changes and ensuring efficient DRAM access by deriving the reference picture using identical processes at both the encoder and decoder.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If the first temporal reference picture in the reference picture list is used as the reference picture for the corresponding block, then the coding process is simplified, but the reference picture changes from slice to slice causing memory access inefficiency and performance bottlenecks
Solution Approach 1:
The patent applies preliminary action by determining and signaling the temporal reference picture index in the slice header before encoding slices. This allows the decoder to pre-identify the reference picture to be used across all slices, avoiding frequent reference picture changes and improving memory access efficiency while maintaining coding simplicity
Solution Approach 2:
The patent makes the temporal reference picture universal across all slices within a picture by signaling it at the slice header level. This single reference picture serves multiple slices, eliminating the need for each slice to independently determine its reference picture, thus improving memory access efficiency without complicating the coding process
2Manufacturing precision
If motion vectors are scaled towards opposite directions, then motion compensation is performed, but pipeline model disruptions occur causing decoder performance degradation
Solution Approach 1:
The patent applies local quality by scaling motion vectors differently based on the reference picture list (L0 or L1). Motion vectors in list 0 are scaled towards the first temporal reference picture, while list 1 vectors are scaled towards the last temporal reference picture. This localized scaling approach maintains motion compensation accuracy for each prediction direction while avoiding pipeline disruptions
Data Source
AI summary
A method of video coding utilizing ARP (advanced residual prediction) by explicitly signaling the temporal reference picture or deriving the temporal reference picture at the encoder and the decoder using identical process is disclosed. To encode or decode a current block in a current picture from a dependent view, a corresponding block in a reference view corresponding to the current block is determined based on a DV (disparity vector). For the encoder side, the temporal reference picture in the reference view of the corresponding block is explicitly signaled using syntax element(s) in the slice header or derived using an identical process as the decoder. For the decoder side, the temporal reference picture in the reference view of the corresponding block is determined according to the syntax element(s) in the slice header or derived using an identical process as the decoder. The temporal reference picture is then used for ARP.