Combining Encoded Video Streams via Slice Segmentation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing communication technologies struggle to efficiently combine and decode multiple video streams in real-time, especially in multi-party video conferencing scenarios, excluding many devices due to their inability to handle simultaneous decoding and display of multiple streams.

Innovation Solution

The technique involves combining independently encoded video streams into a single decodable stream by utilizing existing video codecs that support independent encoding and decoding of image frame regions, such as H.264 or HEVC, without the need for decryption or access to DRM trust zones, allowing for fast and low-latency operation on various devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple video streams are transmitted simultaneously in multi-party video conferencing, then the communication capability is improved, but the device complexity and decoding capability requirements increase

Engineering Contradiction:

Improvemulti-party video conferencing capabilityVSAvoiddecoding capability

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent divides the combined video stream into multiple independently decodable slices, where each slice corresponds to one participant's video stream. This segmentation allows the decoder to process only the required slice rather than decoding the entire combined stream, significantly reducing the decoding capability requirements while maintaining multi-party conferencing functionality.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent combines multiple independently encoded video streams into a single transport stream with a unified syntax structure. This merging allows efficient transmission over the network while preserving the independence of each participant's video data, enabling devices to receive one stream rather than multiple separate streams.

Inventive Principle:

Principle #5Merging (Combining)

2Adaptability or versatility

If multiple video streams are decoded and displayed simultaneously, then the multi-party communication is enabled, but the processing power and energy consumption increase

Engineering Contradiction:

Improvemulti-party communication capabilityVSAvoidprocessing power

Core Design Contradiction:

Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

By segmenting the combined stream into independently decodable slices corresponding to different participants, the patent enables selective decoding. Devices can decode only the slices they need to display, reducing overall processing power requirements and energy consumption compared to decoding multiple complete independent streams.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent changes the organizational parameters of video streams by combining them into a single stream with slice-level independence rather than maintaining multiple separate streams. This parameter change optimizes the balance between transmission efficiency and decoding resource requirements.

Inventive Principle:

Principle #35Parameter changes

3Productivity

If video streams are combined into a single stream, then the transmission efficiency is improved, but the decoding complexity increases

Engineering Contradiction:

Improvetransmission efficiencyVSAvoiddecoding complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The patent resolves the decoding complexity issue by segmenting the combined stream into independently decodable slices. Each slice maintains its own decoding independence, allowing the decoder to process only the necessary portions without having to decode the entire combined stream, thus maintaining low decoding complexity while achieving transmission efficiency.

Inventive Principle:

Principle #1Segmentation

4Adaptability or versatility

If existing video codecs are used without modification, then the compatibility is maintained, but the ability to combine multiple independent streams is lost

Engineering Contradiction:

Improvestream combination capabilityVSAvoidcodec compatibility

Core Design Contradiction:

Adaptability or versatilityVSEase of manufacture

Solution Approach 1:

The patent makes existing video codecs multi-functional by enabling them to carry multiple independent video streams within a single stream structure using slice-based organization. This universal approach allows the same codec to handle both traditional single-stream encoding and the new multi-stream combination capability without requiring separate specialized codecs.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

Instead of creating new specialized codecs for multi-stream handling, the patent inverts the approach by using existing codecs in an innovative way - combining multiple streams into one while maintaining their independence through slice structure. This leverages existing, well-tested codec implementations rather than creating new ones.

Inventive Principle:

Principle #13The other way round (Inversion)

Data Source

PatentUS10666903B1Combining encoded video streams

Publication Date: 2020.05.26 AMAZON TECH INC

AI summary

Techniques are described by which multiple, independently encoded video streams may be combined into a single decodable video stream. These techniques take advantage of existing features of commonly used video codecs that support the independent encoding of different regions of an image frame (e.g., H.264 slices or HEVC tiles). Instead of including different parts of the same image, each region corresponds to the encoded image data of the frames of one of the independent video streams.