Audio Fingerprint Matching for Seamless Mobile Broadcast Interaction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems for interacting with live program broadcasts, such as TV shows, are cumbersome, requiring users to divert attention to dial numbers, send emails, or access social media, deterring participation due to the lack of a seamless interactive experience.

Innovation Solution

A system and method that utilizes a mobile device to capture an audio stream, convert it into an audio fingerprint, and send this information to a server to retrieve and display interactive content associated with the live program broadcast, allowing users to interact without leaving the broadcast.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If users interact with live program broadcasts through traditional methods (calling phone numbers, sending emails, accessing social media), then interaction functionality is provided, but user convenience deteriorates due to cumbersome steps requiring attention diversion

Engineering Contradiction:
Improveuser interaction convenienceVSAvoidinteraction process complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary system consisting of audio fingerprint generation modules and a matching server. This intermediary automatically captures audio from the broadcast, generates fingerprints, matches them with pre-stored program fingerprints, and retrieves corresponding interactive content without requiring users to manually navigate complex interaction processes. The intermediary handles the complexity of audio processing and content matching in the background.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system enables self-service interaction by automatically detecting the live broadcast audio and initiating the content retrieval process without user intervention. The audio fingerprint matching system autonomously identifies the program and retrieves relevant interactive content, eliminating the need for users to manually search or navigate to interaction interfaces.

Inventive Principle:
Principle #25Self-service

2Adaptability or versatility

If users divert attention from the broadcast to interact (dial numbers, open emails, access social media), then interaction capability is enabled, but engagement with the broadcast deteriorates

Engineering Contradiction:
Improveinteraction capabilityVSAvoidbroadcast engagement
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent merges the broadcast viewing experience with interactive content access by combining the audio stream from the broadcast with interactive content retrieval. The system processes the broadcast audio in real-time, matches it with stored program fingerprints, and simultaneously retrieves relevant interactive content, allowing users to engage with both the broadcast and interactive features without switching tasks.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system performs preliminary actions by pre-storing audio fingerprints and corresponding interactive content in a database before the actual interaction is needed. When users watch the broadcast, the system can immediately match the live audio against the pre-stored fingerprints and retrieve relevant content without requiring users to leave the broadcast view.

Inventive Principle:
Principle #10Preliminary action

3Loss of information

If traditional interaction methods are used (visiting websites, dialing numbers), then interactive content can be accessed, but time consumption increases

Engineering Contradiction:
Improveinteractive content accessibilityVSAvoidinteraction time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent replaces the mechanical process of manual navigation (typing URLs, dialing numbers, opening applications) with an automated audio-based recognition system. The system uses audio fingerprint matching to automatically identify the broadcast program and retrieve corresponding interactive content, substituting manual mechanical operations with automated pattern recognition and data retrieval processes.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system changes the interaction parameter from manual input (phone numbers, URLs, email addresses) to audio-based identification. By converting the broadcast audio into a fingerprint parameter and matching it against a database, the system enables rapid content retrieval without requiring users to provide detailed manual input, significantly reducing interaction time.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS9128593B2Enabling an interactive program associated with a live broadcast on a mobile device
Publication Date: 2015.09.08 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • US9128593B2 patent drawing
  • US9128593B2 patent drawing
  • US9128593B2 patent drawing

AI summary

A method of providing an interactive content to a prospective user at a mobile device, the mobile device including a non-transitory computer readable medium including a computer executable program code and a processor for executing the computer executable program code is described. The method includes steps for initiating capture of an audio stream by shaking the mobile device; capturing the audio stream via a microphone in the mobile device; converting the captured audio stream into an audio fingerprint; sending the audio fingerprint to a server; receiving the interactive content from the server if there is a match between audio fingerprints stored on the server, and the audio fingerprint sent by the mobile device; and displaying the interactive content on the mobile device.