Audio Fingerprinting Search Query Generation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current search engines require manual entry of keywords to search for content during media consumption, which can be inconvenient and disrupt the user experience, especially on mobile devices where typing can be cumbersome.
Innovation Solution
A method that involves receiving audio data from a client device, identifying specific content using audio fingerprints, obtaining metadata associated with the content, and generating a search query to retrieve relevant search results without the need for manual keyword entry, allowing for non-keyword-based searches driven by currently viewed or listened-to content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If manual keyword entry is used for searching content during media consumption, then search functionality is provided, but user convenience deteriorates and typing burden increases on mobile devices
Solution Approach 1:
The patent replaces the mechanical typing action with acoustic signal processing. The mobile device captures audio signals from the media player, extracts acoustic features, and uses these features to automatically generate search queries without requiring manual keyboard input. This substitution of mechanical typing with acoustic-based automatic query generation directly resolves the contradiction by improving ease of operation while eliminating typing time loss
2Extent of automation
If audio fingerprinting is used to identify content automatically, then search query generation is automated, but system complexity increases
Solution Approach 1:
The patent implements a multi-functional audio processing system that serves multiple purposes: capturing audio from media players, generating audio fingerprints for content identification, extracting acoustic features for query generation, and searching for related content. By consolidating these functions into a unified audio-based system, the patent achieves high automation while managing complexity through functional integration rather than separate dedicated systems for each task
3Adaptability or versatility
If audio data processing is performed to generate search queries, then non-keyword-based searches are enabled, but processing time increases
Solution Approach 1:
The patent performs preliminary audio fingerprinting and acoustic feature extraction during the audio capture phase, before the actual search query generation is needed. By pre-processing the audio data to extract relevant features and create content identifiers in advance, the system reduces the processing time required at the moment when search results are needed, thus maintaining both versatility and speed
Data Source
AI summary
Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating search queries in response to obtaining audio samples on a client device. In one aspect, a method includes the actions of i) receiving audio data from a client device, ii) identifying specific content from captured media based on the received audio data, wherein the identified specific content is associated with the received audio data and the captured media includes at least one of audio media or audio-video media, iii) obtaining additional metadata associated with the identified content, iv) generating a search query based at least in part on the obtained additional metadata, and v) returning one or more search results to the client device, the one or more search results responsive to the search query and associated with the received audio data.