3D Video Stream Format Identification via System Layer Identifier
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional Scalable Video Coding (SVC) and Multiview Video Coding (MVC) standards lack the ability to properly handle 3D images, particularly in the Side By Side (SBS) video format, where it is difficult to distinguish between coded and uncoded bit streams, and require complex structures for image decoding.
Innovation Solution
An image coding method that includes a video layer for generating a coded stream and a system layer for generating a system stream, where an identifier is multiplexed with the coded stream to indicate whether the image is in a left-right mixed format, enabling proper handling of 3D video formats with base and enhancement layers, and is compliant with MVC and SVC standards.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If conventional SVC or MVC standards are used to code 3D images in SBS format, then coding efficiency is improved, but it becomes difficult to distinguish between coded and uncoded bit streams, requiring complex decoding structures
Solution Approach 1:
The patent divides the bit stream into distinct segments by inserting synchronization markers and format identifiers. The system layer separates the coded stream into identifiable components (base layer, enhancement layer, format indicators), allowing the decoding apparatus to easily distinguish SBS format from other formats without complex analysis, thus reducing decoding structure complexity while maintaining coding efficiency
Solution Approach 2:
The patent introduces an intermediary identifier (frame_packing_info_present_flag and related parameters) that acts as a mediator between the coded stream and the decoding apparatus. This identifier clearly indicates the image format without requiring complex analysis, resolving the contradiction by providing a simple recognition mechanism that maintains coding efficiency while simplifying decoding
2Ease of operation
If an identifier is multiplexed with the coded stream to indicate image format, then image format determination is enabled in the system layer, but the system stream structure becomes more complex
Solution Approach 1:
The patent applies preliminary action by inserting format identifiers and synchronization markers at the beginning of the system stream and at defined intervals. This allows the decoding apparatus to determine the image format early in the processing sequence, before actual decoding begins, thus enabling easy format determination while maintaining a relatively simple and predictable stream structure
Solution Approach 2:
The patent applies local quality by placing format identifiers and synchronization information only at specific locations in the stream (system layer headers, picture parameter sets) rather than throughout the entire stream. This localized approach enables efficient format determination without unnecessarily complicating the overall stream structure, as most of the stream maintains its original simple format
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An image coding method for properly handling a 3D video format including a base layer and an enhancement layer includes a video layer and a system layer. The video layer includes a step (S1801) of coding an image to generate a coded stream. The system layer includes a step (S1802) of multiplexing the coded stream and an identifier to generate a system stream, the identifier indicating whether or not the image has a left-right mixed format that includes a base layer and an enhancement layer and that has a left view image area and a right view image area in each picture. In the coding step (S1801), the image that includes the base layer and the enhancement layer and that has the left view image area and the right view image area in each picture is coded to generate the coded stream, when the image has the left-right mixed format.