Adaptive Camera Parameter Signaling in 3D Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional 3D video coding standards face inefficiencies due to the lack of availability of camera parameters when needed, leading to redundancy and inefficiencies in coding tools that depend on depth data for disparity vector derivation, particularly in scenarios where depth layers are coded before texture layers.
Innovation Solution
Incorporating adaptive camera parameter signaling using control flags derived from logic operations on individual control flags associated with depth-oriented coding tools, ensuring camera parameters are transmitted for non-depth layers and layers that require depth-to-disparity conversion, and restricting redundancy by conditional inclusion in the video bitstream.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If camera parameters are always signaled in the bitstream, then depth-oriented coding tools can function properly, but bitstream redundancy increases
Solution Approach 1:
The patent implements dynamic camera parameter signaling by introducing a control flag that adaptively determines whether to signal camera parameters based on the presence of depth layers and usage of depth-oriented coding tools. This transforms the static approach of always signaling parameters into a dynamic, conditional signaling mechanism that adjusts to specific coding scenarios, resolving the contradiction between reliability and redundancy.
Solution Approach 2:
The patent applies local quality by differentiating the signaling behavior for different layer types (depth layers vs. non-depth layers) and different coding tool configurations. Camera parameters are signaled only in specific local contexts where they are actually needed (non-depth layers using depth-oriented tools), rather than uniformly across all layers, thus reducing overall redundancy while maintaining necessary availability.
2Productivity
If depth layers are coded before texture layers, then coding efficiency improves, but camera parameters become unavailable when needed
Solution Approach 1:
The patent implements preliminary action by ensuring camera parameters are signaled in advance in the bitstream, specifically in non-depth layers that are coded after depth layers. This preliminary signaling guarantees that when the encoder/decoder later needs to perform depth-to-disparity conversion in texture layers, the camera parameters are already available, thus resolving the information unavailability issue while maintaining the efficient depth-first coding order.
3Adaptability or versatility
If camera parameters are signaled for all layers, then depth-to-disparity conversion is always possible, but transmission bandwidth increases
Solution Approach 1:
The patent applies local quality by restricting camera parameter signaling to specific layers (non-depth layers) where they are actually needed for depth-to-disparity conversion, rather than signaling them in all layers. This localized approach maintains the adaptability for depth-to-disparity conversion where required while significantly reducing the overall quantity of transmitted data, thus resolving the bandwidth contradiction.
4Loss of substance
If camera parameters are not signaled, then bitstream size is reduced, but coding tool performance deteriorates
Solution Approach 1:
The patent implements dynamics by making camera parameter signaling conditional rather than static. The control flag dynamically determines parameter inclusion based on actual coding needs (presence of non-depth layers and usage of depth-oriented tools). This ensures parameters are included only when necessary for coding tool performance, avoiding unnecessary bitstream size increase while maintaining reliability where needed.
Data Source
AI summary
A method of three-dimensional video encoding and decoding that adaptively incorporates camera parameters in the video bitstream according to a control flag is disclosed. The control flag is derived based on a combination of individual control flags associated with multiple depth-oriented coding tools. Another control flag can be incorporated in the video bitstream to indicate whether there is a need for the camera parameters for the current layer. In another embodiment, a first flag and a second flag are used to adaptively control the presence and location of camera parameters for each layer or each view in the video bitstream. The first flag indicates whether camera parameters for each layer or view are present in the video bitstream. The second flag indicates camera parameter location for each layer or view in the video bitstream.