Multi-view Video Coding Order Signaling via High Level Syntax
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The current multi-view video coding (MVC) extension of the MPEG-4 AVC standard lacks features for specifying the coding order of each view, leading to ambiguity in view_id assignment and errors in decoding due to missing views, especially under bandwidth limitations or transmission errors.
Innovation Solution
Incorporating high-level syntax in the bitstream to signal video coding order information, allowing flexible assignment of view_id and enabling the decoder to determine the coding order, thereby maintaining continuity and uniqueness of view identifiers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the current MVC extension syntax is used to signal inter-view references, then the syntax structure is simple and follows the existing AVC standard, but the coding order information is missing causing ambiguity in view_id assignment and decoding errors
Solution Approach 1:
The patent applies preliminary action by introducing a new syntax element `view_coding_order[i]` in the sequence parameter set that pre-defines the coding order of each view before the actual video coding process. This allows the decoder to know in advance the expected coding sequence of views, enabling proper error detection and concealment when views are missing or transmitted out of order, thus preventing decoding errors caused by ambiguous view_id assignment.
2Ease of manufacture
If view_id is assigned continuously from 0 to number of views minus 1 without coding order information, then the syntax definition is straightforward and easy to implement, but gaps in view_ids cause ambiguity when some views are not coded
Solution Approach 1:
The patent segments the view identification system into two independent components: (1) the existing continuous view_id assignment from 0 to num_views-1 for syntax simplicity, and (2) a new `view_coding_order[i]` array that explicitly stores the coding sequence of each view. This segmentation allows the system to maintain the simplicity of continuous view_id assignment while adding the necessary coding order information separately, avoiding the need to redesign the entire syntax structure.
3Productivity
If the syntax definition loops through view_id from 0 to number of views minus 1, then the structure is compact and efficient, but it restricts flexible view_id assignment and causes ambiguity when views are skipped
Solution Approach 1:
The patent introduces an intermediary data structure `view_coding_order[num_views]` that acts as a mediator between the compact loop-based syntax structure and the need for flexible view_id assignment. The loop structure remains unchanged for efficiency, but the intermediary array stores the mapping between loop index i and the actual coding order of each view, allowing flexible view_id assignment while maintaining syntax processing efficiency.
Data Source
AI summary
There are provided methods and apparatus for improved signaling using high level syntax for multi-view video coding and decoding. An apparatus includes an encoder for encoding at least one picture for at least one view corresponding to multi-view video content in a resultant bitstream, wherein said encoder signals video coding order information for at least the at least one picture in a high level syntax.