Temporal Enhancement Layer for Stereoscopic Video Encoding

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Many devices are incapable of decoding stereoscopic content encoded according to the multiview video coding (MVC) standard, posing a challenge for content providers offering 3D video experiences in film, television, and virtual reality applications.

Innovation Solution

The use of a temporal enhancement layer to encode stereoscopic content, allowing left and right eye frames to be interleaved, enabling the exploitation of inter-view and intra-view redundancies, thereby allowing devices that do not support MVC to decode stereoscopic content, such as H.265, with minimal increase in bit rate.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If MVC extension is used to encode stereoscopic content, then stereoscopic 3D viewing experience quality is improved, but device compatibility deteriorates as many devices are incapable of decoding MVC-encoded content

Engineering Contradiction:

Improvestereoscopic content encoding qualityVSAvoiddevice compatibility

Core Design Contradiction:

Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The patent segments stereoscopic content encoding into two separate layers: a base layer that can be decoded by all devices, and an enhancement layer that contains additional stereoscopic information for capable devices. This segmentation allows the same content to be universally compatible while maintaining high-quality stereoscopic experience where supported.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The base layer is designed to serve multiple functions: it provides standalone decodable content for all devices, while also serving as a reference for the enhancement layer. This multi-functionality ensures universal compatibility while enabling advanced features for capable devices without requiring separate content streams.

Inventive Principle:

Principle #6Universality (Multi-functionality)

2Manufacturing precision

If separate encoding of left and right eye views is implemented, then stereoscopic depth perception is improved, but bit rate increases significantly

Engineering Contradiction:

Improvestereoscopic depth perception qualityVSAvoidbit rate

Core Design Contradiction:

Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent merges the encoding of left and right eye views by using one view as a reference for encoding the other view in the enhancement layer. Instead of encoding both views independently at full quality, the system combines them into a single bit stream where redundant information is eliminated, significantly reducing the total bit rate while maintaining stereoscopic depth perception quality.

Inventive Principle:

Principle #5Merging (Combining)

Data Source

PatentUS10609356B1Using a temporal enhancement layer to encode and decode stereoscopic video content

Publication Date: 2020.03.31 AMAZON TECH INC

AI summary

Techniques are described that enable stereoscopic content to be delivered. These techniques including encoding frames of stereoscopic video content within a base layer and temporal enhancement layer and decoding the encoded frames.