3D Video Encoding Reducing Occlusion Data Volume
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for encoding 3D video signals face challenges in reducing visible imperfections around depth discontinuities while maintaining coding efficiency and compatibility with existing standards, particularly in auto-stereoscopic displays where processing and transmission capacity are limited.
Innovation Solution
The method involves encoding a 3D video signal with a centre view video frame, depth map, and occlusion data frame, where non-functional occlusion data is distinguished from functional data using a fixed pixel value or range, allowing for reduced bit transmission and increased coding efficiency by eliminating unnecessary data and using reference frames for improved correlation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If all occlusion data is transmitted without distinction, then complete occlusion information is provided, but transmission data volume increases significantly
Solution Approach 1:
The occlusion data frame is segmented into functional and non-functional regions based on depth discontinuity analysis. Only functional regions containing actual occlusion information are transmitted with full data, while non-functional regions are marked with fixed values or omitted, significantly reducing transmission data volume while maintaining complete occlusion information where needed.
Solution Approach 2:
Non-functional occlusion data that does not contribute to image quality is extracted and removed from the transmission stream. The system identifies and eliminates redundant data in occlusion regions where depth discontinuities are below thresholds or where occlusion information can be inferred from reference frames, reducing transmission burden while preserving essential occlusion details.
2Productivity
If compression is applied to reduce data transmission, then transmission efficiency improves, but visible imperfections around depth discontinuities increase
Solution Approach 1:
Different compression strategies are applied to different regions of the occlusion data frame based on local characteristics. Regions with significant depth discontinuities and functional occlusion information undergo minimal or no compression to preserve quality, while regions with smooth depth variations or non-functional data apply higher compression ratios, optimizing both transmission efficiency and image quality locally.
Solution Approach 2:
The system performs preliminary analysis of depth maps and occlusion data before compression to identify critical regions requiring high fidelity. By pre-marking areas with significant depth discontinuities and functional occlusion information, the compression process can be adjusted accordingly, preventing visible imperfections in important regions while maintaining overall transmission efficiency.
3Device complexity
If 3D information is generated at the display side, then processing complexity at transmission is reduced, but image rendering quality deteriorates
Solution Approach 1:
Occlusion data and depth information are pre-processed and prepared at the transmission side before sending to the display device. The encoder generates functional occlusion data frames with proper segmentation and compression settings in advance, so that the display side only needs to perform simple decoding and rendering operations, maintaining both low processing complexity and high image rendering quality.
Solution Approach 2:
Instead of generating all 3D information at the display side through complex real-time processing, the system creates optimized copies of occlusion data and depth maps at the transmission side. These pre-prepared data structures are transmitted efficiently and can be directly used by the display device for high-quality rendering without requiring complex local processing.
4Adaptability or versatility
If occlusion data is compressed using existing standards, then compatibility is improved, but coding efficiency for 3D information decreases
Solution Approach 1:
The occlusion data frame is segmented into functional and non-functional regions that can be encoded separately using different strategies. Functional regions use compression methods compatible with existing video standards to ensure interoperability, while non-functional regions are handled more efficiently through fixed-value encoding or omission, improving overall coding efficiency for 3D information while maintaining standard compatibility.
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
In a method for encoding and an encoder for a 3D video signal, centre view frames, a depth map for centre view frames and an occlusion data frame are encoded. On the basis of the depth map for the centre view frame a distinction is made between functional and non- functional data in an occlusion data frame. This allows a strong reduction in bits needed for the encoded occlusion data frame. In the decoder a combined data stream is made of functional data in the encoded occlusion data frames and the centre view frames. Preferably the centre view frames are used as reference frames in encoding the occlusion data frames.