Synchronized Multi-Viewpoint Streaming via Offset File Mediation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Live streaming of esports and gaming events faces challenges in providing a synchronized viewer experience due to multiple interesting viewpoints, which existing technologies have not effectively addressed.

Innovation Solution

A method and system for synchronized streaming of multiple data streams, where a server encodes and analyzes time data to create an offset file detailing the time relationship between streams, allowing client devices to synchronize the streaming of multiple viewpoints by adjusting start times based on device capabilities and metadata, ensuring synchronized playback.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple data streams are streamed simultaneously from different servers or sources, then the quantity of viewpoints available to viewers is improved, but the synchronization between streams deteriorates due to timing drift and network variability

Engineering Contradiction:
Improvenumber of viewpointsVSAvoidsynchronization
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

A synchronization server is introduced as an intermediary between the streaming servers and client devices. This mediator receives data streams from multiple sources, analyzes their timing characteristics, creates offset files with synchronization information, and distributes this information to clients. The intermediary coordinates the timing of multiple independent streams without requiring changes to the original streaming sources, thus maintaining versatility while achieving reliable synchronization.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The synchronization server performs preliminary analysis of timing data from multiple data streams before distribution to clients. Offset files containing pre-calculated synchronization information are created in advance based on the analysis of visual data and time metadata. This preliminary action allows client devices to synchronize streams by simply applying the pre-computed offset values, rather than requiring complex real-time synchronization algorithms.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If time synchronization is achieved through complex server-side coordination, then the synchronization accuracy is improved, but the device complexity and computational requirements worsen

Engineering Contradiction:
Improvesynchronization accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The complex synchronization analysis and calculation functions are extracted from client devices and concentrated in the synchronization server. The server performs the heavy computational work of analyzing timing data, creating offset files, and determining synchronization parameters. Client devices are relieved of this complexity and only need to implement simple logic to read and apply the offset values provided in the offset files, thus achieving high synchronization accuracy without increasing client device complexity.

Inventive Principle:
Principle #2Taking out (Extraction)

3Ease of operation

If offset files are created and distributed with each data stream, then the ease of operation for synchronized playback is improved, but the loss of time increases due to additional file transmission and processing

Engineering Contradiction:
Improvesynchronized playbackVSAvoidtime overhead
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The offset file is merged with the data stream transmission process. The synchronization server creates the offset file based on analysis of the data stream timing characteristics and transmits it together with the corresponding data stream to the client device. This combining of the synchronization information with the data stream itself eliminates the need for separate synchronization file transmission, reducing time overhead while maintaining ease of synchronized playback operation.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11283852B2Methods and nodes for synchronized streaming of a first and a second data stream
Publication Date: 2022.03.22 ZNIPE ESPORTS AB
  • US11283852B2 patent drawing
  • US11283852B2 patent drawing
  • US11283852B2 patent drawing

AI summary

Disclosed is a method performed by a system of a communications network. The method comprises encoding the first data stream and the second data stream, analyzing time data related to the first and second data stream, in order to determine a time relationship between the first and second data streams. The method comprises creating an offset file comprising the time relationship between the first and second data streams and transmitting the first data stream, the first time metadata, the second time metadata and the offset file. The method comprises receiving the first data stream, the first time metadata, the second time metadata and the offset file and streaming the first data stream. The method comprises determining a start time for the second data stream, obtaining the second data stream and streaming the second data stream, such that the first and second data streams and synchronized.