Backward-Compatible Stereoscopic Video Streaming via Metadata Packing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for generating and distributing stereoscopic video streams require high bit-rates, making them uneconomical for broadcasting, and existing backward-compatible techniques either waste bandwidth or require dual video streams, which is inefficient.

Innovation Solution

A method that uses metadata within the stereoscopic video stream to identify regions containing left and right images, allowing a single stream to be decoded as either 2D or 3D by using existing H.264/AVC decoders without modifications, and an additional decoder for 3D viewing, reducing bandwidth requirements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If two independent high-definition video streams are used for stereoscopic content, then the quality and stereoscopic effect are improved, but the bandwidth and transmission cost increase significantly

Engineering Contradiction:
Improvestereoscopic qualityVSAvoidbandwidth
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent combines two independent high-definition video streams (left and right eye views) into a single composite video stream by packing them together. The encoder packs the two views into one stream using packing indicators to mark the boundaries of each view, thereby reducing bandwidth requirements while preserving stereoscopic quality. This directly resolves the contradiction by merging two streams into one without sacrificing the stereoscopic effect.

Inventive Principle:
Principle #5Merging (Combining)

2Quantity of substance

If a single video stream is used for both 2D and 3D displays, then bandwidth is reduced, but compatibility with existing 2D decoders must be maintained

Engineering Contradiction:
ImprovebandwidthVSAvoiddecoder compatibility
Core Design Contradiction:
Quantity of substanceVSAdaptability or versatility

Solution Approach 1:

The patent creates a universal video stream that can be decoded by both traditional 2D decoders and new 3D-capable decoders. The packing indicators are inserted in a way that does not interfere with standard H.264/AVC decoding, allowing 2D decoders to ignore them and process the stream normally. Meanwhile, 3D decoders can detect and utilize these indicators to extract separate left and right views. This multi-functionality resolves the contradiction between bandwidth reduction and decoder compatibility.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The packing indicators serve as an intermediary mechanism that enables 3D functionality without disrupting existing 2D decoding processes. These indicators act as a bridge between the single composite stream and the dual-view extraction process, allowing seamless integration with both 2D and 3D display systems while maintaining backward compatibility.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If depth maps or multiview techniques are used for backward compatibility, then 2D/3D compatibility is achieved, but the bit-rate remains too high for broadcasting

Engineering Contradiction:
Improve2D/3D compatibilityVSAvoidbit-rate
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent merges the left and right video views into a single compressed stream using efficient packing techniques, rather than transmitting them separately as in multiview approaches. By utilizing the temporal and spatial redundancy between the two views and applying standard H.264/AVC compression to the packed stream, the bit-rate is significantly reduced compared to transmitting separate streams or using depth map techniques, while still achieving backward compatibility.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentEP2559257B1Method for generating and rebuilding a stereoscopic-compatible video stream and related coding and decoding devices
Publication Date: 2020.05.13 SISVEL SOCIETA ITALIANA PER LO SVILUPPO DELL ELETTRONICA SPA
  • EP2559257B1 patent drawingFigure 1a~1c
  • EP2559257B1 patent drawingFigure 2
  • EP2559257B1 patent drawingFigure 3a~3c

AI summary

The invention relates to a method for generating a digital stereoscopic video stream (101) comprising container frames (C), said container frames (C) comprising information about a right image (R) and a left image (L), wherein, when coding said digital stereoscopic video stream (101), at least one metadatum (M) is entered which is adapted to identify a region of a container frame (C) containing only one of said two images (L,R).