Media Stream Synchronization via Relative Offset Calculation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Capturing and synchronizing data/media streams from multiple devices, such as smart classrooms, is complicated due to differing capture rates, timestamps, and activation/deactivation times, necessitating a purpose-built multimedia capture device that can combine streams into a fully synchronized media file for remote transmission.

Innovation Solution

A processor-based apparatus with multiple input ports captures and synchronizes media streams by determining capture start times, calculating relative offset times, and combining frames to form synchronized media files, which can be transmitted to remote compute devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple media streams are captured from different devices with differing capture rates and timestamps, then the ability to record live media recordings is improved, but the complexity of synchronizing these streams increases

Engineering Contradiction:
Improveability to capture streams from multiple devicesVSAvoidcomplexity of synchronizing streams
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent introduces a synchronization mechanism that uses timestamp-based offset calculation as an intermediary to coordinate multiple media streams. The system calculates relative offset times between streams and uses these offsets to align frames from different capture devices, effectively mediating the synchronization complexity without requiring complex real-time coordination between devices

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary synchronization actions by calculating and storing relative offset times for each media stream before combining them into a synchronized output. This preliminary calculation of timing offsets allows the system to pre-process the synchronization requirements, reducing the complexity during actual stream combination

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If capture start times and relative offset times are calculated to synchronize frames from multiple streams, then synchronization accuracy is improved, but the processing time required increases

Engineering Contradiction:
Improvesynchronization accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces complex real-time mechanical synchronization mechanisms with a computational approach using timestamp-based offset calculations. Instead of relying on hardware-level synchronization or complex timing protocols, the system uses software-based timestamp analysis and mathematical offset computation to achieve precise synchronization, which is more efficient and scalable

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Reliability

If frames from multiple streams are combined into a synchronized media file, then the quality of the integrated output is improved, but the complexity of stream integration increases

Engineering Contradiction:
Improvequality of integrated outputVSAvoidcomplexity of stream integration
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the stream integration process into distinct, manageable components: detecting media samples from each stream, determining capture start times, calculating relative offset times for each stream, and finally combining frames using these offsets. This segmentation allows each synchronization step to be handled independently, reducing the overall complexity of integrating multiple streams while maintaining high output quality

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10902884B2Methods and apparatus for ordered serial synchronization of multimedia streams upon sensor changes
Publication Date: 2021.01.26 ECHO 360 INC
  • US10902884B2 patent drawing
  • US10902884B2 patent drawing
  • US10902884B2 patent drawing

AI summary

An apparatus includes a processor with first and second input ports and a memory operably coupled to the processor. The processor can detect streams of media samples at the input ports and determine, in response to the detection of the streams of media samples, a capture start time. The processor can also capture a first frame of a first stream of media samples beginning at the capture start time, and a first frame of a second stream of media samples beginning at a first time subsequent to the capture start time. The processor can also calculate a relative offset time based on the capture start time, the first time, and a rate associated with the second stream of media samples, and store, in the memory, an indication of an association between the captured first frame of the second stream of media samples and the relative offset time.