Audio Retrieval Using Spectrogram Energy Extreme Points
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing music retrieval methods based on texture analysis are not robust to block noise and have high calculation complexity, while methods based on extreme points are sensitive to random noise, leading to potential missed matches and reduced accuracy.
Innovation Solution
The method involves acquiring a spectrogram of an audio clip, identifying energy extreme points, determining image blocks, extracting local features, and generating a local feature sequence for audio information retrieval, which reduces noise sensitivity and improves accuracy by using local features instead of extreme points.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If methods based on extreme points are used for audio retrieval, then retrieval speed is improved, but sensitivity to random noise increases leading to missed matches
Solution Approach 1:
The patent segments the spectrogram into multiple local regions around each extreme point, extracting features from each region separately. This segmentation allows the system to capture local structural information while maintaining the speed benefits of extreme point-based methods, thereby improving matching accuracy without sacrificing retrieval speed.
Solution Approach 2:
The patent applies local quality by extracting features from specific local regions surrounding extreme points rather than using global features. This local feature extraction makes the retrieval more robust to noise while maintaining computational efficiency, as it focuses on localized patterns that are less susceptible to random noise interference.
2Device complexity
If a single extreme point is used for matching, then calculation complexity is reduced, but the probability of missed matches increases due to noise sensitivity
Solution Approach 1:
The patent merges multiple local features from different regions around extreme points into a comprehensive feature representation. This combining approach maintains relatively low computational complexity while improving match accuracy by aggregating information from multiple local areas, making the system more robust to noise without requiring excessive computational resources.
Solution Approach 2:
The patent transitions from one-dimensional extreme point coordinates to two-dimensional local region features by extracting features from spectral bins around each extreme point. This dimensional expansion provides more discriminative power for matching while maintaining computational efficiency through the use of hash tables and compact feature representations.
Data Source
AI summary
Embodiments of the present invention provide an audio information retrieval method and device. The method includes acquiring a spectrogram of an audio clip, extracting a local feature of at least one energy extreme point in the spectrogram to use as a local feature sequence of the audio clip, and conducting an audio information retrieval according to the local feature sequence of the audio clip to acquire audio information. Embodiments of the present invention reduce the probability of a missed match (e.g., false negative) and improve the accuracy of audio information retrieval.


