Streaming Client Interactivity Window Synchronization

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing technologies face challenges in efficiently processing interactivity events for streamed media data, particularly during unplanned advertisements in live broadcasts, where precise timing and synchronization of interactive content with main media content are difficult to predict and manage.

Innovation Solution

A method where a streaming client determines the start and end times of an interactivity window and signals application-specific interactivity events to a media presentation application, ensuring that interactive content is delivered only within this window, using techniques such as Dynamic Adaptive Streaming over HTTP (DASH) or HTTP Live Streaming (HLS), allowing users to interact with media during predetermined intervals.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If interactivity events are processed for streamed media data, then user engagement is improved, but processing overhead on media applications increases

Engineering Contradiction:

Improveuser engagementVSAvoidprocessing overhead

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The patent segments the interactivity event processing into two distinct parts: (1) event message parsing and timing window determination performed by the streaming client, and (2) actual event delivery to media applications performed by the media player. This segmentation reduces processing overhead on media applications while maintaining user engagement capabilities.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The streaming client acts as an intermediary between the media server and media applications. It receives event messages, determines timing windows, and selectively delivers events to media applications only when they are active and within the interactivity window, thereby reducing processing overhead while maintaining engagement.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Reliability

If interactivity events are delivered outside the interactivity window, then completeness of event delivery is improved, but synchronization with media content deteriorates

Engineering Contradiction:

Improveevent delivery completenessVSAvoidsynchronization precision

Core Design Contradiction:

ReliabilityVSManufacturing precision

Solution Approach 1:

The streaming client performs preliminary action by determining the interactivity timing window before delivering events to media applications. It calculates the window based on event message timing information and uses this pre-computed window to control event delivery, ensuring synchronization with media content while maintaining delivery completeness.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent implements dynamic timing window adjustment where the streaming client continuously monitors media playback time and adjusts the interactivity window accordingly. The window is dynamically opened and closed based on real-time synchronization with media content, ensuring precise timing while delivering complete events.

Inventive Principle:

Principle #15Dynamics

3Measurement precision

If streaming client determines and signals interactivity events, then timing precision is improved, but device complexity increases

Engineering Contradiction:

Improvetiming precisionVSAvoidstreaming client complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The streaming client performs multiple functions: it streams media data, parses event messages, determines timing windows, and delivers events to media applications. By consolidating these functions into a single component with standardized interfaces, the patent achieves timing precision without proportionally increasing device complexity.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS10938872B2Processing interactivity events for streaming media data

Publication Date: 2021.03.02 QUALCOMM INC

AI summary

An example device for retrieving media data includes a streaming client and a media presentation application configured in one or more processors implemented in circuitry. The streaming client is configured to determine a start time for an event message corresponding to an interactivity window during which one or more application-specific interactivity events can occur during presentation of media data, the application-specific interactivity events comprising times during which a user of the device can interact with the presented media data, determine an end time for the event message corresponding to the interactivity window, receive data representative of at least one of the application-specific interactivity events during the interactivity window corresponding to the event message, and forward the data representative of the at least one of the application-specific interactivity events to the media presentation application.