Depth Map Delivery Formats for Stereoscopic Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 3D video delivery systems, particularly stereoscopic and auto-stereoscopic displays, face challenges in providing adaptable depth maps for varying viewer preferences and device resolutions, with existing methods often requiring multiple views and lacking backwards compatibility with traditional systems.
Innovation Solution
The development of advanced depth map delivery formats that encode residual depth map data, using a combination of side-by-side and top-and-bottom picture encoding, along with texture and depth-map reference processing units, to generate and decode multiple views and depth information, ensuring compatibility with both legacy and advanced decoders.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple views are provided for auto-stereoscopic displays, then adaptability to different display types is improved, but device complexity increases
Solution Approach 1:
The depth map data is segmented into multiple views (first view, second view, third view, fourth view) that can be independently encoded and delivered. This segmentation allows the system to provide multiple views for auto-stereoscopic displays while maintaining manageable complexity through structured organization of the data streams
Solution Approach 2:
The encoding system is designed to be universal, capable of delivering depth map data for both stereoscopic displays (requiring fewer views) and auto-stereoscopic displays (requiring multiple views). The same infrastructure can adapt to different display types by selectively delivering appropriate views, eliminating the need for separate systems for each display technology
2Adaptability or versatility
If depth map information is delivered with multiple views, then adaptability for retargeting is improved, but loss of information increases
Solution Approach 1:
The depth map data structure is nested, with higher-resolution depth information contained within the bitstream. The system can deliver a base level of depth information that is sufficient for lower-resolution displays while embedding additional high-resolution depth data that can be extracted when needed for retargeting to higher resolutions, thus preventing information loss across different quality levels
3Productivity
If residual depth map data is encoded, then encoding efficiency is improved, but device complexity increases
Solution Approach 1:
The system performs preliminary encoding of depth map data into a standardized format with embedded metadata that describes the data structure and requirements. This preliminary preparation simplifies the actual encoding process during transmission by providing pre-organized data that requires less complex processing at the receiving end, thus improving overall encoding efficiency while managing system complexity
Data Source
Figure 1A~1B
Figure 1C~1D
Figure 2A~2B
AI summary
Stereoscopic video data and corresponding depth map data for stereoscopic and auto-stereoscopic displays are coded using a coded base layer and one or more coded enhancement layers. Given a 3D input picture and corresponding input depth map data, a side-by-side and a top-and-bottom picture are generated based on the input picture. Using an encoder, the side-by-side picture is coded to generate a coded base layer Using the encoder and a texture reference processing unit (RPU), the top-and-bottom picture is encoded to generate a first enhancement layer, wherein the first enhancement layer is coded based on the base layer stream, and using the encoder and a depth-map RPU, depth data for the side-by-side picture are encoded to generate a second enhancement layer, wherein the second enhancement layer is coded based on to the base layer. Alternative single, dual, and multi-layer depth map delivery systems are also presented.