Depth-Luma Coding With Edge-Based Joint Block Partitioning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding systems struggle to efficiently encode and decode depth and texture information jointly, leading to suboptimal compression and transmission efficiency.
Innovation Solution
Implement cross-component depth-color coding (JDCC) techniques that utilize depth information to jointly encode and decode texture information, such as luma and chroma components, by determining coding modes and edge locations for partitioning blocks.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If joint depth-color coding mode is used to encode depth and texture information together, then compression efficiency is improved, but decoding complexity increases due to the need to determine coding modes and perform joint reconstruction
Solution Approach 1:
The block is divided into multiple partitions based on edge locations, with different coding modes applied to different partitions. This segmentation allows the decoder to handle complex joint depth-color coding only in specific regions where it provides benefit, while using simpler independent coding in other regions, thus reducing overall decoding complexity while maintaining compression efficiency.
Solution Approach 2:
Joint depth-color coding is applied selectively to specific partitions rather than uniformly to the entire block. The decoder determines the coding mode for each partition independently, applying the computationally intensive joint coding only where necessary (in regions with specific edge characteristics), thereby reducing overall decoding complexity while preserving compression efficiency in critical areas.
2Device complexity
If independent decoding of color samples is used when JDCC mode is disabled, then decoding complexity is reduced, but compression efficiency deteriorates due to loss of correlation between depth and texture information
Solution Approach 1:
Different coding approaches are applied to different spatial regions based on local characteristics. In partitions where depth-texture correlation is strong (determined by edge analysis), joint depth-color coding is applied to maximize compression efficiency. In other partitions, independent decoding is used to minimize complexity, thus achieving local optimization of both compression efficiency and decoding complexity.
3Manufacturing precision
If edge-based partitioning is performed to apply different coding modes to different partitions, then coding precision is improved, but device complexity increases due to edge detection and partition determination
Solution Approach 1:
Edge detection and partition determination are performed as preliminary steps before the actual depth and color sample decoding. By identifying edge locations and determining partitions in advance, the decoder can efficiently select appropriate coding modes for each partition without adding significant complexity to the main decoding process, thus improving coding precision while controlling device complexity.
Data Source
AI summary
Systems, methods, and instrumentalities are disclosed for cross-component depth-luma coding. Depth information may be used as information for joint or cross-component coding of texture information (e.g., luma, chroma, or R, G, B colour component information). The depth information may be used to jointly code the corresponding texture information. In examples, a device may determine whether a coding mode, such as a joint depth-color coding mode (JDCC) (e.g., joint depth-luma coding mode (JDLC)) is used for a current block. If JDCC coding mode is used for the block, then the device may decode depth sample(s) in the block and predict the corresponding color sample(s) (e.g., luma sample(s) and/or chroma sample(s)) in the block based on the decoded depth sample(s).