Audio Retrieval Using Spectrogram Energy Extreme Points

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing music retrieval methods based on texture analysis are not robust to block noise and have high calculation complexity, while methods based on extreme points are sensitive to random noise, leading to potential missed matches and reduced accuracy.

Innovation Solution

The method involves acquiring a spectrogram of an audio clip, identifying energy extreme points, determining image blocks, extracting local features, and generating a local feature sequence for audio information retrieval, which reduces noise sensitivity and improves accuracy by using local features instead of extreme points.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If methods based on extreme points are used for audio retrieval, then retrieval speed is improved, but sensitivity to random noise increases leading to missed matches

Engineering Contradiction:
Improveretrieval speedVSAvoidmatching accuracy
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent segments the spectrogram into multiple local regions around each extreme point, extracting features from each region separately. This segmentation allows the system to capture local structural information while maintaining the speed benefits of extreme point-based methods, thereby improving matching accuracy without sacrificing retrieval speed.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by extracting features from specific local regions surrounding extreme points rather than using global features. This local feature extraction makes the retrieval more robust to noise while maintaining computational efficiency, as it focuses on localized patterns that are less susceptible to random noise interference.

Inventive Principle:
Principle #3Local quality

2Device complexity

If a single extreme point is used for matching, then calculation complexity is reduced, but the probability of missed matches increases due to noise sensitivity

Engineering Contradiction:
Improvecalculation complexityVSAvoidmatch accuracy
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent merges multiple local features from different regions around extreme points into a comprehensive feature representation. This combining approach maintains relatively low computational complexity while improving match accuracy by aggregating information from multiple local areas, making the system more robust to noise without requiring excessive computational resources.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent transitions from one-dimensional extreme point coordinates to two-dimensional local region features by extracting features from spectral bins around each extreme point. This dimensional expansion provides more discriminative power for matching while maintaining computational efficiency through the use of hash tables and compact feature representations.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS10127309B2Audio information retrieval method and device
Publication Date: 2018.11.13 BANMA ZHIXING NETWORK HONGKONG CO LTD
  • US10127309B2 patent drawing
  • US10127309B2 patent drawing
  • US10127309B2 patent drawing

AI summary

Embodiments of the present invention provide an audio information retrieval method and device. The method includes acquiring a spectrogram of an audio clip, extracting a local feature of at least one energy extreme point in the spectrogram to use as a local feature sequence of the audio clip, and conducting an audio information retrieval according to the local feature sequence of the audio clip to acquire audio information. Embodiments of the present invention reduce the probability of a missed match (e.g., false negative) and improve the accuracy of audio information retrieval.