3D Video Encoding Redundancy Exploitation via Signaling
Solution Overview
Problem
Current standards such as scalable video coding (SVC) and multi-view video coding (MVC) do not support three-dimensional video (3DV) formats, which require synchronization of different components for encoding and decoding, leading to inefficiencies in redundancy exploitation and backward compatibility issues.
Innovation Solution
The proposal reuses existing MVC or SVC extensions to transmit 3DV content by signaling how to extract 3DV components correctly using high-level syntax, such as sequence parameter sets, picture parameter sets, or supplemental enhancement information messages, allowing for flexible backward compatibility and efficient exploitation of cross-component redundancy without synchronization at the system level.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If current standards (SVC/MVC) are used for 3DV encoding, then backward compatibility is maintained, but redundancy exploitation between components is inefficient
Solution Approach 1:
The patent segments 3DV content into distinct components (video views, depth maps, occlusion maps) and encodes them separately using existing SVC/MVC standards, while using signaling information to indicate their relationships. This allows legacy decoders to process individual components independently (maintaining backward compatibility) while enabling advanced decoders to exploit inter-component redundancy for improved coding efficiency.
Solution Approach 2:
The patent introduces signaling information as an intermediary mechanism that bridges existing video coding standards with new 3DV requirements. The signaling data indicates how video and depth components are related without requiring changes to the underlying SVC/MVC frameworks, thus enabling efficient redundancy exploitation while preserving backward compatibility.
2Adaptability or versatility
If synchronization of different components is required for encoding and decoding, then 3DV format support is achieved, but system complexity increases
Solution Approach 1:
The patent extracts the synchronization requirement from the encoding/decoding process itself and relocates it to the signaling information layer. By indicating component relationships through signaling data rather than enforcing strict synchronization protocols, the patent reduces system complexity while maintaining 3DV format support.
Solution Approach 2:
The patent performs preliminary organization of 3DV components during encoding by embedding signaling information that pre-describes their relationships. This preliminary action eliminates the need for complex runtime synchronization mechanisms, as decoders can use the pre-provided signaling data to correctly associate components.
3Adaptability or versatility
If full 3DV data is transmitted, then 3D display functionality is enabled, but data transmission volume increases
Solution Approach 1:
The patent applies partial action by allowing decoders to process only the necessary subset of 3DV components based on their capabilities and requirements. Base-layer decoders can process essential video components for 2D display, while advanced decoders can utilize additional depth and occlusion components for 3D rendering, thus reducing overall data transmission requirements while maintaining full 3D functionality where needed.
Data Source
AI summary
Several implementations relate to 3D video formats. One or more implementations provide adaptations to MVC and SVC to allow 3D video formats to be used. According to a general aspect, a set of images including video and depth is encoded. The set of images is related according to a particular 3D video format, and are encoded in a manner that exploits redundancy between the set of images. The encoded images are arranged in a bitstream in a particular order, based on the particular 3D video format that relates to the images. The particular order is indicated in the bitstream using signaling information. According to another general aspect, a bitstream is accessed that includes the encoded set of images. The signaling information is also accessed. The set of images is decoded using the signaling information.