Audio Fingerprint Time Shift Detection for Media Analytics

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods fail to accurately determine time shifts and content consumption patterns in media playback, particularly in determining static and dynamic time differences between a reference and an audio playback, which is crucial for understanding viewer habits and content engagement.

Innovation Solution

The use of audio signatures and fingerprints generated from audio signals, compared against a reference database to determine time offsets and changes in playback habits, allowing for the identification of skipped, replayed, or consumed content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If audio signatures are compared against a reference database to determine time offsets, then measurement precision of time shift is improved, but device complexity increases due to database comparison requirements

Engineering Contradiction:
Improvetime shift determination accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent creates audio fingerprints as simplified copies or representations of the original audio content. These fingerprints are condensed digital summaries that retain the essential characteristics needed for identification and time shift detection, enabling comparison against reference database entries without requiring full audio analysis

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent introduces audio fingerprints as an intermediary representation between the original audio signal and the reference database. The fingerprint acts as a mediator that simplifies the comparison process by transforming complex audio data into a standardized format that can be efficiently matched against reference entries to determine time offsets

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If remote audio signatures are received and processed over communication channels, then content recognition capability is improved, but loss of time occurs during transmission and processing

Engineering Contradiction:
Improvecontent recognition capabilityVSAvoidprocessing time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent performs audio fingerprint generation and preprocessing actions in advance, before the actual content recognition is needed. By pre-processing the audio into fingerprint format and preparing reference database entries beforehand, the system reduces the time required for real-time comparison and recognition when audio signatures are received over communication channels

Inventive Principle:
Principle #10Preliminary action

3Loss of information

If audio samples are captured and processed for identification, then information about viewer habits is obtained, but loss of information may occur during sampling and transmission

Engineering Contradiction:
Improveinformation preservationVSAvoidcontent recognition efficiency
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The patent extracts only the essential and distinctive features from the complete audio signal to create the audio fingerprint. This extraction process removes redundant information while retaining the critical characteristics needed for identification and time shift detection, thereby preserving the most important information about viewer habits and content consumption patterns

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS10575126B2Apparatus and method for determining audio and/or visual time shift
Publication Date: 2020.02.25 ALPHONSO INC
  • US10575126B2 patent drawing
  • US10575126B2 patent drawing
  • US10575126B2 patent drawing

AI summary

An system for determining time offset of an audio signature from a reference signature time stamp may have a server connected to one or more remote devices. The server may have a receiver connected to one of more communication channels configured to receive an audio signature generated by the remote device and transmitted over the communication channel. The system may have a database at or connected to the server that contains one or more reference audio signatures. Each of the reference audio signatures may have a time stamp also stored in the database. A query engine may compare the remote audio signature to one or more reference audio signatures stored in the database. A processor may be provided to compare a reference timestamp to a timestamp associated with said remote audio signature. The system may be used to evaluate viewing habits and particularly delayed viewing and program playback manipulation such as Fast-forward, slow-motion, skip, rewind and program abandonment.