MPEG-2 Multiview Video Coding Non-Consecutive View Transmission

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current MPEG-2 systems face limitations in efficiently transmitting and decoding multiview video coding (MVC) data, particularly in handling non-consecutive views within MVC video streams, which can lead to out-of-order arrival of views at client devices and inefficient bandwidth usage.

Innovation Solution

The proposed solution enhances MPEG-2 transport streams and program streams by introducing a descriptor that signals non-consecutive view order indexes, allowing for the transmission of sub-bitstreams with non-consecutive views and enabling client devices to reorder them correctly, ensuring proper decoding and efficient bandwidth utilization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional MPEG-2 transport streams are used to transmit MVC video streams, then the system maintains compatibility with existing MPEG-2 infrastructure, but it cannot efficiently handle non-consecutive views leading to out-of-order arrival at client devices

Engineering Contradiction:

Improvecapability to handle non-consecutive viewsVSAvoidview delivery order

Core Design Contradiction:

Adaptability or versatilityVSReliability

Solution Approach 1:

The patent segments the MVC bitstream into multiple sub-bitstreams, where each sub-bitstream contains a subset of views with non-consecutive view order indexes. This segmentation allows selective transmission of specific views while maintaining the ability to handle non-consecutive view sequences, resolving the contradiction between adaptability and reliability.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary data structure (descriptor) that carries view order index information between the encoder and decoder. This intermediary enables the system to track and reorder non-consecutive views properly, maintaining reliable view delivery order while supporting enhanced adaptability for selective view transmission.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Loss of information

If all views are transmitted in the MVC video stream, then complete view information is available for decoding, but bandwidth consumption increases inefficiently

Engineering Contradiction:

Improveview information completenessVSAvoidbandwidth consumption

Core Design Contradiction:

Loss of informationVSLoss of energy

Solution Approach 1:

The patent extracts and transmits only the necessary subset of views rather than all views. By using sub-bitstreams that contain only specific views with non-consecutive view order indexes, the system removes unnecessary data transmission, reducing bandwidth consumption while maintaining complete view information for the selected views.

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies partial action by transmitting a partial set of views (sub-bitstreams) rather than the complete set. This allows the system to convey sufficient view information for the intended application while avoiding the excessive bandwidth consumption that would result from transmitting all possible views.

Inventive Principle:

Principle #16Partial or excessive action

3Productivity

If sub-bitstreams with non-consecutive views are transmitted, then bandwidth efficiency is improved, but the receiving device must perform additional reordering operations

Engineering Contradiction:

Improvebandwidth utilization efficiencyVSAvoidreordering operation complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by embedding view order index information in descriptors within the sub-bitstreams before transmission. This pre-packaging of ordering information allows the receiving device to perform simple reordering operations based on pre-provided instructions, reducing the actual reordering complexity at the receiver while maintaining bandwidth efficiency.

Inventive Principle:

Principle #10Preliminary action

4Device complexity

If conventional MVC transmission is used, then the system structure remains simple, but decoder efficiency decreases due to out-of-order view arrival

Engineering Contradiction:

Improvesystem structure simplicityVSAvoiddecoder efficiency

Core Design Contradiction:

Device complexityVSProductivity

Solution Approach 1:

The patent changes the parameter of view order indexing by introducing non-consecutive view order indexes in the descriptor structure. This parameter change allows the system to maintain a relatively simple overall structure while enabling the decoder to efficiently process views in the correct order, even when transmitted as non-consecutive sub-bitstreams, thereby improving decoder efficiency.

Inventive Principle:

Principle #35Parameter changes

Data Source

PatentUS8411746B2Multiview video coding over MPEG-2 systems

Publication Date: 2013.04.02 QUALCOMM INC

AI summary

A multiplexer may produce an MPEG-2 (Motion Picture Experts Group) System standard bitstream comprising views with nonconsecutive view order indexes. In one example, an apparatus includes a video encoder that encodes views of a scene, and a multiplexer that constructs a data structure for signaling that a corresponding MPEG-2 (Motion Picture Experts Group) System standard bitstream includes a first view of the views of the scene associated with a first view order index and a second view of the plurality of views of the scene associated with a second view order index. The first view order index and the second view order index are non-consecutive. The apparatus may further include an output interface that outputs the data structure.