Real-Time Audio Matching Ranking System

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In audio matching systems, identifying exact matches from multiple near-exact versions of audio content, such as extended play tracks and original songs, is challenging due to variance in melodies and characteristics, especially when only a partial audio file is provided, leading to difficulties in determining when to return matches and which ones to prioritize.

Innovation Solution

A real-time ranking system that continuously evaluates and ranks matches based on confidence scores, holding back less popular matches until a higher confidence threshold is met, using feature vectors and scoring components to determine the relevance and popularity of audio samples, ensuring accurate and confident match results.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If the system returns matches immediately upon identification, then the response time is reduced, but the accuracy and confidence of match results deteriorates due to multiple near-exact versions in the data store

Engineering Contradiction:
Improveresponse timeVSAvoidmatch accuracy
Core Design Contradiction:
Loss of timeVSMeasurement precision

Solution Approach 1:

The system performs preliminary ranking of all potential matches before returning results. The ranking component continuously evaluates matches against the incoming audio stream and maintains a ranked list, ensuring that only the highest-confidence match is returned. This preliminary ranking action resolves the contradiction by preparing match quality in advance while managing response time through threshold-based early termination.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system processes more audio data than the minimum required for initial match identification. By continuing to analyze the audio stream beyond the point where a match is first identified, the system accumulates additional confidence evidence. This excessive processing action improves match accuracy by filtering out false positives from near-exact versions, while the threshold mechanism prevents excessive delay.

Inventive Principle:
Principle #16Partial or excessive action

2Measurement precision

If the system analyzes the complete audio file before matching, then the match accuracy improves, but the processing time increases significantly

Engineering Contradiction:
Improvematch accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system dynamically adjusts the matching process based on incoming audio data. The ranking component continuously updates match confidence scores as more audio data becomes available, and the system can terminate early when a high-confidence match is identified. This dynamic approach allows the system to process less data when possible (reducing time) while maintaining accuracy through continuous re-evaluation of matches as the audio stream progresses.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system implements feedback through continuous ranking and re-evaluation of matches as the audio stream is processed. The ranking component provides ongoing feedback about match quality, allowing the system to adjust processing intensity. When confidence scores indicate a clear winner, the system can stop processing; when matches remain close, the system continues analyzing more audio data. This feedback loop resolves the contradiction by adapting processing time to actual match certainty.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP2939103B1Hold back and real time ranking of results in a streaming matching system
Publication Date: 2019.03.06 GOOGLE LLC
  • EP2939103B1 patent drawingFigure 1
  • EP2939103B1 patent drawingFigure 2
  • EP2939103B1 patent drawingFigure 3

AI summary

A matching system receives probe audio samples for comparison to references of a data store. Comparisons are generated to determine a sufficient match for a portion or a first amount of the probe sample. Ranking scores are assigned to the resulting match references. The match references are retained, unless meeting a score threshold. Comparisons are continually generated with second amounts of the probe sample and the retained references are updated with further matching references assigned ranking scores. The retained results are merged and determined to satisfy a score threshold for release as outputted results for matching references.