Audio Fingerprinting for Event Media Synchronization

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Low-quality audio content recorded by audience members at events is often distorted and fragmented, making it inaudible and unwatchable, while official recordings lack the personal perspective of fans and spectators.

Innovation Solution

A method and system that uses tag data and fingerprint data to match low-quality audio content with better-quality audio content, compensating for timing misalignment, and replacing or augmenting the low-quality audio with the matched portion to improve the audio quality in media content synchronized with video.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If audience members record media content using smartphones and hand-held recording devices, then they capture personalized perspectives of event performances, but the audio quality becomes low, distorted, and fragmented making content inaudible and unwatchable

Engineering Contradiction:

Improvepersonalized perspective captureVSAvoidaudio quality

Core Design Contradiction:

Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The system uses an intermediary processing pipeline that includes audio fingerprinting, database matching, and automated replacement to bridge the gap between low-quality audience recordings and high-quality source audio. The intermediary system identifies matching content and substitutes audio tracks without requiring manual intervention.

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces manual audio editing and quality improvement processes with automated digital signal processing systems. Audio fingerprinting algorithms and automated matching systems substitute for manual assessment and editing, enabling bulk processing of audience recordings.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Manufacturing precision

If official recordings are provided for event performances, then high-quality audio is available, but the personal perspective and fan experience captured by audience members is lost

Engineering Contradiction:

Improveaudio qualityVSAvoidpersonal perspective capture

Core Design Contradiction:

Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The system merges the advantages of both official and audience recordings by combining high-quality source audio with audience-captured video and metadata. This creates hybrid media content that preserves both audio fidelity and the personal perspective of fans.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The patent creates composite media content by layering different audio sources with video content. The system produces composite media files that contain synchronized video from audience devices with replaced or augmented audio from official sources, combining the strengths of both recording types.

Inventive Principle:

Principle #40Composite materials

3Ease of operation

If low-quality audio content is used in media content, then audience recordings can be easily captured and shared, but the content becomes inaudible and unwatchable

Engineering Contradiction:

Improverecording and sharingVSAvoidaudio clarity

Core Design Contradiction:

Ease of operationVSReliability

Solution Approach 1:

The system performs preliminary audio replacement before content is shared or distributed. Audio fingerprinting and matching occur in advance, allowing the content to be prepared with high-quality audio substituted before it reaches the audience, ensuring reliability without compromising ease of sharing.

Inventive Principle:

Principle #10Preliminary action

4Manufacturing precision

If audio replacement and synchronization processing is performed, then audio quality is improved, but processing time and computational resources are required

Engineering Contradiction:

Improveaudio qualityVSAvoidprocessing time

Core Design Contradiction:

Manufacturing precisionVSLoss of time

Solution Approach 1:

The system extracts audio fingerprints and creates databases of available audio content in advance, before actual replacement is needed. This preliminary processing enables rapid matching and replacement during the actual media content creation, significantly reducing processing time.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent implements partial processing by applying audio replacement only to segments of media content where it is most needed, rather than processing entire files uniformly. This selective approach reduces overall processing time while maintaining audio quality where it matters most.

Inventive Principle:

Principle #16Partial or excessive action

Data Source

PatentUS20240223839A1Event Source Content and Remote Content Synchronization

Publication Date: 2024.07.04 VAUDIO LTD

AI summary

A method of replacing low-quality audio content by better-quality audio content in media content comprising the low-quality audio content and video content. The low-quality audio content can be replaced with a received portion of the better-quality audio content by compiling the received portion of the audio content with the video content. Included is any of: compensating for an amount of timing misalignment between the low-quality audio content and the received portion of audio content; obtaining fingerprint data for the audio content of the media content by using hash values of spectrogram frequency peaks; and obtaining one or more feature vectors from the audio content of the media content to reduce a size of a search of stored instances of audio content.