Multi-View Video Depth Partitioning for Efficient View Synthesis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing immersive video coding methods require intensive computational resources and suboptimal image quality due to the need for depth estimation in the decoder, which is based on lesser-quality decoded texture components, leading to non-optimal view synthesis.
Innovation Solution
A method that partitions depth components into blocks, obtains depth information from texture data, and codes depth estimation parameters instead of the depth blocks, reducing computational complexity and memory usage while maintaining image quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If depth maps are coded and transmitted to the decoder, then view synthesis quality is improved, but bandwidth consumption and transmission time increase
Solution Approach 1:
The patent extracts only the essential depth information (depth estimation parameters) from the complete depth map, transmitting merely the necessary parameters rather than the full depth map data. This allows the decoder to reconstruct depth maps with acceptable quality while significantly reducing the quantity of data transmitted over the network.
Solution Approach 2:
The encoder performs preliminary depth estimation and parameter extraction before transmission, pre-processing the depth maps to identify and transmit only the critical parameters needed for reconstruction. This preliminary action reduces the data volume that needs to be transmitted while preserving the essential information for view synthesis.
2Quantity of substance
If depth estimation is performed in the decoder based on decoded texture components, then bandwidth consumption is reduced, but image quality deteriorates due to non-optimal depth estimation
Solution Approach 1:
The patent introduces depth estimation parameters as an intermediary between the transmitted data and the final depth map reconstruction. These parameters serve as a bridge that enables the decoder to generate accurate depth maps without transmitting the complete depth map, thus improving image quality while maintaining reduced bandwidth consumption.
Solution Approach 2:
The patent changes the representation of depth information from full depth maps to compressed depth estimation parameters. By transforming the depth data into a more efficient parameter format, the system achieves both reduced bandwidth consumption and maintained or improved image quality through optimized parameter encoding and decoding.
3Manufacturing precision
If complete depth maps are transmitted, then view synthesis accuracy is improved, but computational resources and memory usage increase
Solution Approach 1:
The patent extracts and transmits only the essential depth parameters rather than complete depth maps, significantly reducing the data size that needs to be processed. This extraction approach maintains view synthesis accuracy while reducing the computational resources and memory usage required for depth map processing and view synthesis operations.
Solution Approach 2:
The encoder performs preliminary processing to extract and compress depth estimation parameters before transmission. This pre-processing reduces the amount of data that reaches the decoder, thereby reducing the computational burden on the decoder and improving overall system efficiency while maintaining synthesis accuracy.
4Device complexity
If depth estimation parameters are coded instead of depth blocks, then computational complexity is reduced, but information loss may occur
Solution Approach 1:
The patent transforms depth block data into optimized depth estimation parameters through a carefully designed parameter encoding scheme. This parameter transformation maintains the essential depth information needed for accurate view synthesis while significantly reducing computational complexity, as the parameters are more compact and require less processing to reconstruct the original depth maps.
Data Source
AI summary
A method implemented by a decoding device for decoding views representing a scene from different positions or different view angles. The method includes: for a depth component of at least one view and for a current block of the depth component, the depth component being partitioned into at least one block: reading an information that indicates whether the current block is subdivided into smaller blocks, if the current block is subdivided into smaller blocks, decoding an information that specifies a depth interval associated with each smaller block, and if the current block is not subdivided into smaller blocks, decoding an information that specifies a depth interval associated with the current block.