Video Stream Compatibility Signaling for Stereoscopic 3D

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems face challenges in compatible communication and rendering of stereoscopic three-dimensional video data across different devices, as they may not be able to identify whether received video data includes frame-packed stereoscopic 3D information, leading to inefficient resource usage and potential degradation in visual quality.

Innovation Solution

Incorporating compatibility information within the video data, such as through frame packing arrangement service extension information (SEI) messages, to indicate the presence of frame-packed stereoscopic 3D data, allowing devices to determine compatibility at the sequence or bit-stream layer, thereby optimizing resource allocation and decoding processes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If compatibility information is not included in video data, then devices cannot identify stereoscopic 3D content, but including compatibility information increases data structure complexity

Engineering Contradiction:
Improveidentification of stereoscopic 3D contentVSAvoiddata structure
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The video data structure is segmented into multiple layers: base layer (standard video data) and extension layer (SEI messages containing compatibility information). This segmentation allows receiving devices to process only the necessary layer based on their capabilities, avoiding the need to parse complex unified structures while ensuring 3D content identification is available when needed.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

SEI (Service Extension Information) messages act as an intermediary mechanism between the video content and the receiving device. These messages carry compatibility information without requiring changes to the core video coding standards, enabling graceful extension of functionality while maintaining compatibility with existing devices.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Use of energy by moving object

If devices process all video data without compatibility checks, then resource usage increases, but skipping processing may degrade visual quality

Engineering Contradiction:
Improvedevice resource usageVSAvoidvisual quality
Core Design Contradiction:
Use of energy by moving objectVSReliability

Solution Approach 1:

Compatibility information is embedded in SEI messages that are processed before main video decoding. This preliminary action allows devices to determine in advance whether the video contains stereoscopic 3D content, enabling them to allocate appropriate processing resources and select the correct decoding path before actual video processing begins.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The processing system dynamically adapts its behavior based on the compatibility information received. Devices can switch between different processing modes (2D decoding, 3D decoding, or rejection) based on their capabilities and the content type indicated in SEI messages, optimizing resource usage while ensuring proper quality for supported formats.

Inventive Principle:
Principle #15Dynamics

3Adaptability or versatility

If devices support multiple video formats, then versatility increases, but compatibility determination becomes more difficult

Engineering Contradiction:
Improvevideo format supportVSAvoidcompatibility determination
Core Design Contradiction:
Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

SEI messages provide a universal mechanism that works across different video coding standards and device types. The same SEI message structure can convey compatibility information for various video formats (2D, stereoscopic 3D, other formats), allowing a single processing approach to handle multiple formats without increasing determination complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS9674499B2Compatible three-dimensional video communications
Publication Date: 2017.06.06 QUALCOMM INC
  • US9674499B2 patent drawing
  • US9674499B2 patent drawing
  • US9674499B2 patent drawing

AI summary

Information for a video stream indicating whether the video stream includes stereoscopic three-dimensional video data can be provided to a display device. This information allows the device to determine whether to accept the video data and to properly decode and display the video data. This information can be made available for video data regardless of the codec used to encode the video. Systems, devices, and methods for transmission and reception of compatible video communications including stereoscopic three-dimensional picture information are described.