Audio Spectrum Classifier for Harmonic vs Noisy Mode Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing speech-music classifiers in audio coding fail to adequately discriminate between different classes of music signals, particularly harmonic and noise-like music segments, leading to insufficient resolution in complex multimode codecs.
Innovation Solution
A novel metric based on peakyness and local energy concentration measures is calculated in the frequency domain to determine the appropriate encoding mode, using a combination of crest and crest mod values to differentiate between harmonic and noisy components in the spectrum.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If existing speech-music classifiers are used, then the basic classification between speech and music can be performed, but the discrimination between different classes of music signals (harmonic and noise-like) is insufficient
Solution Approach 1:
The patent segments the music signal classification task into two distinct sub-tasks: (1) detecting peakyness using crest factor analysis to identify harmonic content, and (2) detecting noisiness using spectral flatness and zero-crossing rate to identify noise-like content. This segmentation allows each sub-task to be optimized independently, achieving fine-grained discrimination between harmonic and noise-like music segments that generic speech-music classifiers cannot accomplish.
Solution Approach 2:
The patent applies local quality analysis by examining specific spectral characteristics at different frequency bands and time moments. Instead of using a single global classifier, it analyzes local spectral flatness, zero-crossing rates, and crest factors at specific points in the spectrum to identify the local nature of the signal (harmonic vs. noise-like), enabling precise discrimination based on local signal properties.
2Reliability
If a single encoding mode is used for all signal types, then the codec structure remains simple, but the encoding performance deteriorates for specific signal classes requiring specialized handling
Solution Approach 1:
The patent implements dynamic mode selection where the encoder adapts its behavior based on real-time signal characteristics. The mode decision logic dynamically switches between different encoding modes (e.g., harmonic mode for peaky signals, noise-like mode for non-peaky signals) based on the calculated crest factor and spectral flatness, allowing the codec to optimize performance for each signal type without requiring a completely complex static structure.
Solution Approach 2:
The patent changes encoding parameters based on signal characteristics by using the calculated peakyness and noisiness parameters as control signals. When crest factor exceeds a threshold (indicating peaky/harmonic signal), the system switches to a encoding mode optimized for such signals. When spectral flatness indicates noise-like characteristics, a different encoding mode is activated. This parameter-based adaptation optimizes encoding performance while maintaining manageable system complexity.
3Measurement precision
If detailed analysis of spectral characteristics is performed, then the discrimination between harmonic and noise-like signals improves, but the computational complexity increases
Solution Approach 1:
The patent replaces complex mechanical signal processing systems with more efficient mathematical operations in the frequency domain. Instead of using complex time-domain analysis or multiple sequential filters, it substitutes direct computation of spectral flatness and zero-crossing rate from frequency-domain coefficients, which are more computationally efficient and provide the necessary discrimination accuracy with reduced complexity.
Solution Approach 2:
The patent changes the approach by computing only the most critical spectral parameters (spectral flatness, zero-crossing rate, crest factor) rather than performing complete spectral analysis. This selective parameter extraction maintains high classification accuracy while significantly reducing computational burden, as these three parameters capture the essential characteristics needed to distinguish harmonic from noise-like signals.
Data Source
Figure 1
Figure 2A~2B
Figure 3
AI summary
A method in an encoder to determine which of two encoding modes or groups of encoding modes to use is provided. The method includes deriving (1001) a frequency spectrum of an input audio signal. The method includes obtaining (1003) a magnitude of a critical frequency region of the frequency spectrum. The method includes obtaining (1005) a peakyness measure of the frame. The method includes obtaining (1007) a noise band detection measure. The method includes determining (1009) which one of the two encoding modes or groups of encoding modes to use based on at least the peakyness measure and the noise band detection measure. The method includes encoding (1011) the input audio signal based on the encoding mode determined to use.