Ancillary Data Synchronization via Automatic Content Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current technologies are inadequate in extracting and synchronizing ancillary data related to media content, often requiring explicit data connections and relying on metadata that may not be consistently present throughout the signal chain, limiting the types and utilization of ancillary data.

Innovation Solution

The integration of dynamic audio or time code and Automatic Content Recognition (ACR) technologies, including fingerprinting, to synchronize ancillary data with media content, enabling indirect connectivity and the use of new ancillary data types such as coordinates of the visual portion of audiovisual content, which allows for advanced utilization and feedback mechanisms.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If current methods of synchronization are used, then explicit data connection is required, but system complexity and connectivity requirements increase

Engineering Contradiction:
Improvesynchronization reliabilityVSAvoiddata connection complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent introduces ACR technology as an intermediary that automatically identifies content and retrieves ancillary data without requiring explicit data connections between source and target. The ACR system acts as a mediator that bridges the gap between content delivery and ancillary data synchronization, eliminating the need for complex direct connections while maintaining reliable synchronization.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system enables self-service synchronization where the consumer's ACR system automatically identifies the content being played back and independently retrieves the corresponding ancillary data from databases. This eliminates the need for external coordination or explicit data connections, allowing the system to self-synchronize ancillary data based on automatic content recognition.

Inventive Principle:
Principle #25Self-service

2Ease of operation

If metadata-based synchronization is used, then simplicity is maintained, but ancillary data may not be present throughout the signal chain

Engineering Contradiction:
Improvesynchronization easeVSAvoidancillary data availability
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent implements feedback mechanisms where the ACR system continuously monitors content playback, identifies the content, and retrieves ancillary data based on this identification. This feedback loop ensures that ancillary data is reliably obtained and synchronized even when not present in the original signal chain, maintaining both ease of operation and data availability.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent replaces the mechanical metadata-based synchronization system with an ACR-based system that uses automatic content recognition and database lookup. This substitution maintains the simplicity of operation while dramatically improving reliability, as the ACR system can reliably identify content and retrieve ancillary data regardless of whether metadata was preserved through the signal chain.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If traditional ancillary data types are used, then compatibility is maintained, but data utilization is limited

Engineering Contradiction:
Improvedata type flexibilityVSAvoidcontent utilization efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent applies universality by creating a unified ancillary data system that can handle multiple data types (text, graphics, video, coordinates, and other structured data) through a single ACR-based framework. This multi-functional approach maintains compatibility with traditional data types while enabling versatile utilization across e-commerce, data tracking, search, audience measurement, and other applications.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces coordinates as a new dimension of ancillary data that overlays spatial information onto traditional content data. This dimensional addition transforms how content can be utilized, enabling applications like interactive advertising, location-based services, and enhanced visual experiences without compromising compatibility with existing data types.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

4Measurement precision

If ACR technology with fingerprinting is implemented, then synchronization accuracy is improved, but processing complexity increases

Engineering Contradiction:
Improvesynchronization precisionVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by pre-processing content to generate fingerprints and pre-organizing ancillary data in databases indexed by these fingerprints. This preliminary preparation enables highly precise synchronization during playback without requiring complex real-time processing, as the ACR system simply needs to match the fingerprint against pre-existing data structures.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP4096227A1Coordinates as ancillary data
Publication Date: 2022.11.30 SOURCE DIGITAL INC
  • EP4096227A1 patent drawingFigure 1A
  • EP4096227A1 patent drawingFigure 1B
  • EP4096227A1 patent drawingFigure 1C

AI summary

Coordinates as ancillary data in a media environment driven content distribution platform may include obtaining synchronization data and ancillary data that identifies a set of coordinates representing a location within a visual portion of the audiovisual content, the ancillary data pegged to instants in the synchronization data, and communicating the synchronization data and the ancillary data pegged to the instants in the synchronization data such that subsequent alignment of the synchronization data to the audiovisual content synchronizes the set of coordinates representing the location within the visual portion of the audiovisual content.