Time Synchronization of Video and Meta-data in Mobile Devices

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current technologies fail to effectively synchronize multiple sources of live information, such as HLS video and meta-data, that are published and processed at different rates, making it difficult for mobile devices to display this information in a coherent manner.

Innovation Solution

The system synchronizes HLS video and meta-data by using time-stamped protocols like GPS timing, where video and audio data are transmitted via satellite networks and meta-data via IP packet data communications, with an origin server ingesting and encoding these signals to ensure they are displayed in real-time on mobile devices like tablets.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple sources of live information (HLS video and meta-data) are transmitted from different sources at different rates, then the system can provide diverse and comprehensive information, but the different transmission rates cause timing misalignment and make it difficult to display information coherently

Engineering Contradiction:

Improveability to receive multiple sources of live informationVSAvoidtiming alignment between different information streams

Core Design Contradiction:

Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent introduces a time synchronization mechanism as an intermediary layer between the different information streams (HLS video and meta-data). This intermediary uses time-stamped protocols to mediate the timing differences, allowing both streams to be synchronized for coherent display without requiring them to be transmitted at the same rate from the outset.

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The system changes the timing parameter of the information streams by applying time-stamping and synchronization protocols. This allows the video and meta-data, which were originally transmitted at different rates, to have their timing parameters adjusted so that they align correctly for simultaneous display, resolving the contradiction between receiving diverse information and maintaining timing precision.

Inventive Principle:

Principle #35Parameter changes

2Adaptability or versatility

If HLS video and meta-data are transmitted via different networks (satellite and IP packet data), then the system can utilize multiple transmission channels for redundancy and flexibility, but the different network paths result in different transmission rates and processing delays

Engineering Contradiction:

Improvemulti-channel transmission capabilityVSAvoidtransmission latency and processing delay

Core Design Contradiction:

Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent implements a feedback mechanism where the system monitors the arrival times of video and meta-data packets from different networks. Based on this feedback about transmission delays, the system dynamically adjusts synchronization parameters to compensate for the time differences, ensuring coherent display despite the multi-channel transmission approach introducing latency variations.

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The system performs preliminary time-stamping of both video and meta-data packets as they are received from different networks. This preliminary action records the arrival times before processing, allowing the synchronization mechanism to later align the streams correctly. This preliminary timing capture enables the system to handle the different transmission rates from satellite and IP packet data networks without resulting in display misalignment.

Inventive Principle:

Principle #10Preliminary action

3Productivity

If the system processes and assembles video and meta-data in real-time from different sources, then the system can provide up-to-date information, but the different processing rates make it difficult to maintain synchronization

Engineering Contradiction:

Improvereal-time information processing capabilityVSAvoidsynchronization precision between different data streams

Core Design Contradiction:

ProductivityVSManufacturing precision

Solution Approach 1:

The time synchronization mechanism serves as an intermediary that processes timing information from both video and meta-data streams separately, then coordinates their assembly. This intermediary approach allows each stream to be processed at its own optimal rate while maintaining precise synchronization at the point of assembly, resolving the contradiction between real-time processing capability and synchronization precision.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS9560312B2Time synchronization of video and data inside a mobile device

Publication Date: 2017.01.31 CELLCO PARTNERSHIP INC

AI summary

A video player tablet, or a mobile device includes a processor configured to receive live video and audio data from a communication network and format the video and audio data for display on the tablet. The processor is also configured to receive live meta-data from the communication network and format the meta-data for display on the same tablet. The processor is further configured to select the meta-data, and time synchronize the selected meta-data with the video and audio data for simultaneous display on the tablet, or mobile device.