Adaptive Depth Data Encoding for Immersive Video
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for encoding depth data in immersive video struggle to efficiently encode occupancy information without introducing errors that lead to visual artifacts during transmission and compression.
Innovation Solution
A method of encoding depth data that analyzes the depth values to dynamically define subsets of levels for representing occupied and unoccupied parts of the depth map, allowing for adaptive encoding that minimizes errors and visual artifacts.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If occupancy information is embedded in depth data by reserving a particular depth value, then encoding efficiency is improved, but compression or transmission errors may corrupt occupancy data leading to visual artifacts
Solution Approach 1:
The patent segments the depth data into two distinct parts: a first part containing depth values for occupied pixels and a second part containing occupancy information for unoccupied pixels. This segmentation allows independent encoding and compression of each part, preventing errors in one part from affecting the other, thus resolving the contradiction between encoding efficiency and data accuracy.
Solution Approach 2:
The patent extracts occupancy information from the depth data by identifying and separating pixels based on their occupancy status. By taking out occupancy information as a distinct component rather than embedding it within depth values, the system eliminates the risk of compression or transmission errors corrupting occupancy data while maintaining encoding efficiency.
2Reliability
If occupancy map is encoded separately from depth data, then occupancy data accuracy is maintained, but additional data structures must be transmitted
Solution Approach 1:
The patent merges the encoding of depth data and occupancy information into a unified structure where the depth data itself is divided into parts that simultaneously convey both depth information and occupancy status. This combining approach eliminates the need for separate occupancy maps or additional data structures, reducing overall system complexity while maintaining data accuracy.
Data Source
AI summary
Methods of encoding and decoding depth data are disclosed. In an encoding method, depth values and occupancy data are both encoded into a depth map. The method adapts how the depth values and occupancy data are converted to map values in the depth map. For example, it may adaptively select a threshold, above or below which all values represent unoccupied pixels. By adapting how the depth and occupancy are encoded, based on analysis of the depth values, the method can enable more effective encoding and transmission of the depth data and occupancy data. The encoding method outputs metadata defining the adaptive encoding. This metadata can be used by a corresponding decoding method, to decode the map values. Also provided are an encoder and a decoder for depth data, and a corresponding bitstream, comprising a depth map and its associated metadata.