Dynamic Content Modification via Frame Format Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Media clients face challenges in dynamically modifying media streams, particularly in identifying and matching frame formats, which can lead to failures in dynamic content modification processes due to differences in frame formats between the received media stream and the expected format, resulting in poor user experiences.

Innovation Solution

A computing system determines the frame format of the media stream being processed and uses this information to ensure that replacement or overlay content is in the correct format, facilitating successful client-side fingerprint matching and dynamic content modification by providing reference fingerprints specific to the identified frame format.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the media client performs dynamic content modification without considering frame format differences, then the content modification process is simpler and faster, but the format mismatch causes failures in fingerprint matching and poor user experience

Engineering Contradiction:
Improvecontent modification speedVSAvoidfingerprint matching success
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system determines the frame format parameter of the received media stream and uses this information to select appropriate reference fingerprints. By changing the parameter selection based on frame format (e.g., choosing between different frame format variants of the same media stream), the system achieves both fast processing and reliable fingerprint matching without format mismatches

Inventive Principle:
Principle #35Parameter changes

2Device complexity

If the media client uses a single set of reference fingerprints for all frame formats, then the system complexity is reduced, but format-specific fingerprint matching fails when frame formats differ

Engineering Contradiction:
Improvereference fingerprint managementVSAvoidframe format accuracy
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

Instead of using a single universal reference fingerprint set, the system maintains multiple sets of reference fingerprints corresponding to different frame formats. The appropriate reference fingerprint set is selected based on the detected frame format of the received media stream, ensuring precise matching for each specific frame format while organizing the complexity in a structured manner

Inventive Principle:
Principle #3Local quality

3Reliability

If the media client dynamically determines frame format and selects appropriate reference fingerprints, then fingerprint matching reliability is improved, but the processing time and system complexity increase

Engineering Contradiction:
Improveframe format identification accuracyVSAvoidframe format detection time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs frame format determination and reference fingerprint selection in advance, before the actual content modification process begins. By pre-identifying the frame format and preparing the appropriate reference fingerprints ahead of time, the system minimizes processing delays during the critical content modification window while ensuring accurate format identification

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11641495B2Use of video frame format as basis for differential handling of automatic content recognition and associated action
Publication Date: 2023.05.02 ROKU INC
  • US11641495B2 patent drawing
  • US11641495B2 patent drawing
  • US11641495B2 patent drawing

AI summary

A computing system that identifies a media stream that a media client is processing for presentation determines which frame format of the media stream the media client is processing for presentation. And the computing system uses that determined frame format as a basis to facilitate dynamic content modification. For instance, based on then determined frame format, the computing system could work to ensure that replacement or overlay content that the media client obtains to facilitate dynamic content modification of the media stream is of that determined frame format. Further or alternatively, based on the determined frame format, the computing system could work to ensure that the media client gets provisioned with reference fingerprints of that particular frame format of the media stream, for use to facilitate client-side fingerprint matching to confirm that the media stream continues to be identified media stream.