Refined Depth Map Coding via Refinement Signals
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current multi-view video coding technologies face inefficiencies in coding depth data, as existing methods often require transmitting two separate depth maps for coding and rendering, which is costly and not optimal for compression.
Innovation Solution
The proposal is to transmit a refinement signal of the depth images, which can modify the original depth images for improved coding efficiency, using the original depth images for rendering and the modified depth images for coding, thereby enhancing compression efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If two separate depth maps are transmitted for coding and rendering, then coding accuracy is improved, but data transmission cost increases
Solution Approach 1:
The depth information is segmented into two functional components: original depth maps for rendering and refinement signals for coding. This segmentation allows each component to serve its specific purpose optimally - original depth maps maintain rendering quality while refinement signals provide coding accuracy improvements with minimal data transmission
Solution Approach 2:
Refinement signals act as intermediaries that bridge the gap between original depth maps and coded depth maps. These refinement signals are transmitted separately and applied to modify the original depth maps, enabling accurate coding without transmitting complete alternative depth maps
2Manufacturing precision
If original depth images are used for rendering and modified depth images for coding, then rendering quality is maintained, but system complexity increases
Solution Approach 1:
The system dynamically selects which depth map version to use based on the operational context - original depth maps are used for rendering operations while modified depth maps (original + refinement) are used for coding operations. This dynamic approach allows the system to optimize for different priorities without requiring complete system redesign
Solution Approach 2:
Different quality levels are applied locally to different functional streams: high-quality original depth maps are preserved for rendering where visual quality is paramount, while enhanced modified depth maps are used for coding where accuracy is paramount. This local quality differentiation maintains overall system efficiency
3Productivity
If refinement signals are transmitted to modify depth images, then compression efficiency is improved, but processing complexity increases
Solution Approach 1:
Instead of transmitting complete modified depth maps, only the essential refinement signals are transmitted. This partial action approach provides sufficient improvement for coding accuracy without the overhead of transmitting full depth map replacements, achieving compression efficiency gains with minimal additional processing
Data Source
AI summary
Various implementations are described. Several implementations relate to a refined depth map. According to one aspect, depth information for a picture in a set of pictures is accessed. Modified depth information for the picture is accessed. A refinement is determined that characterizes a difference between the depth information and the modified depth information. The refinement, and the depth information, is provided for use in processing one or more pictures in the set of pictures.