Mosaic Video Streaming for Low-Latency Multi-View Playback

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing technologies face challenges in efficiently streaming multiple live-stream media items simultaneously due to high processing resource consumption and hardware limitations, leading to significant latency and inability to support concurrent viewing on devices with single video decoder capabilities.

Innovation Solution

A server-generated mosaic video stream is created by combining multiple live-stream media items into a single stream, allowing simultaneous presentation on client devices without additional hardware support, with features like audio track selection, full screen mode, and closed captions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If multiple live-stream media items are streamed simultaneously on client devices, then users can view multiple items concurrently, but processing resource consumption increases significantly

Engineering Contradiction:

Improveconcurrent viewing capabilityVSAvoidprocessing resource consumption

Core Design Contradiction:

ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent merges multiple live-stream media items into a single mosaic video stream on the server side. Multiple source video streams are combined into one encoded stream that is then transmitted to the client device, allowing the client to display multiple items concurrently without processing multiple separate streams locally. This reduces client processing resource consumption while maintaining concurrent viewing capability.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The server acts as an intermediary that performs the resource-intensive task of combining multiple video streams. Instead of requiring the client device to process multiple simultaneous streams, the server pre-combines them into a mosaic stream, which then serves as the input for the client's single video decoder. This intermediary approach shifts the processing burden from the client to the server.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Productivity

If multiple live-stream media items are streamed simultaneously, then concurrent viewing is enabled, but latency increases significantly

Engineering Contradiction:

Improveconcurrent viewing capabilityVSAvoidlatency

Core Design Contradiction:

ProductivityVSLoss of time

Solution Approach 1:

By merging multiple source video streams into a single mosaic stream on the server, the patent eliminates the need for the client to manage multiple separate stream connections and decoders. This consolidation reduces the cumulative latency that would otherwise result from processing multiple independent streams sequentially or in parallel on the client device.

Inventive Principle:

Principle #5Merging (Combining)

3Adaptability or versatility

If devices with single video decoder capabilities stream multiple media items, then hardware limitations are overcome, but processing resource consumption increases

Engineering Contradiction:

Improvehardware compatibilityVSAvoidprocessing resource consumption

Core Design Contradiction:

Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The patent enables devices with single video decoder capabilities to display multiple live-stream media items by merging all source streams into a single mosaic stream before transmission. The client device's single video decoder processes only one stream (the mosaic stream), while the server handles the complexity of combining multiple source streams. This approach maintains hardware compatibility without requiring clients to consume excessive processing resources.

Inventive Principle:

Principle #5Merging (Combining)

4Ease of operation

If server combines multiple source video streams into mosaic stream, then processing resource consumption on client is reduced, but server processing complexity increases

Engineering Contradiction:

Improveclient processing requirementVSAvoidserver processing complexity

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The server serves as an intermediary that assumes the complexity of combining multiple video streams. This is a acceptable trade-off because the server is designed with higher processing capacity and dedicated resources for stream combination, while client devices can use their simpler, single-decoder hardware without requiring complex processing capabilities.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS12501086B2Server-generated mosaic video stream for live-stream media items

Publication Date: 2025.12.16 GOOGLE LLC

AI summary

Methods and systems for a server-generated mosaic video stream of live-stream media items are provided herein. A plurality of source video streams is identified by a server. The plurality of source video streams are combined into a mosaic video stream, wherein each source video stream of the plurality of source video streams occupies a corresponding spatial fragment of a predefined shape within a visual rendering of the mosaic video stream, and wherein video frames of the plurality of source video streams are simultaneously present within the mosaic video stream. The mosaic video stream is transmitted to a client device for decoding and visual rendering within an output window.