Source Separation Audio Processing for Hearing Assistance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Hearing assistance devices face challenges in processing audio signals with multiple simultaneous sounds of different levels, leading to improper gain application and resulting in artificial envelope fluctuations and distorted auditory experiences, particularly in music and movie soundtracks.
Innovation Solution
The system employs source separation and remixing techniques to isolate individual audio sources, apply optimal gain and compression, and mix them back into the original signal, minimizing audible artifacts and enhancing sound quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If multiple simultaneous sounds are processed together through a single gain control mechanism, then device complexity is reduced, but manufacturing precision of gain application deteriorates causing improper gain distribution
Solution Approach 1:
The patent segments the audio signal processing by separating different sound sources (speech, music, noise) into distinct channels, each with its own gain control mechanism. This allows independent optimization of gain for each source type while maintaining overall system manageability through modular architecture.
Solution Approach 2:
The patent applies different gain control characteristics to different frequency regions and sound source types. Each segment of the audio spectrum receives tailored gain processing appropriate to its characteristics, achieving local optimization rather than uniform processing across all frequencies and sources.
2Ease of operation
If a single gain value is applied to multiple simultaneous sounds in the same frequency region, then ease of operation is improved, but sound quality deteriorates due to artificial envelope fluctuations
Solution Approach 1:
The patent segments simultaneous sounds into separate processing channels based on their source characteristics. Speech, music, and noise components are identified and routed to different gain control paths, allowing each to receive appropriate gain values independently rather than being forced into a single gain value.
Solution Approach 2:
The patent implements dynamic gain control that adapts in real-time to the characteristics of each sound source. The system continuously monitors the audio input and adjusts gain values dynamically based on the detected sound source type and its temporal envelope characteristics, preventing artificial fluctuations.
3Object-generated harmful factors
If source separation and independent processing is applied to multiple audio sources, then sound quality is improved, but device complexity increases
Solution Approach 1:
The patent divides the audio processing system into segmented parallel channels, each handling a specific sound source type. This segmentation allows independent optimization of each channel while maintaining overall system organization through modular architecture, reducing the complexity burden compared to a monolithic processing approach.
Solution Approach 2:
The patent implements a universal processing framework that handles multiple sound source types through a common architectural structure. The same basic processing blocks (separation, gain control, mixing) are reused across different source types, reducing overall complexity despite the multi-functional capabilities.
4Object-generated harmful factors
If real-time source separation and remixing is performed, then sound quality is improved, but processing time increases
Solution Approach 1:
The patent performs preliminary classification of sound sources using lightweight spectral analysis before full processing. By identifying sound source types in advance through quick spectral features, the system can route signals to appropriate processing paths without requiring complete analysis of all signal components, reducing overall processing time.
Solution Approach 2:
The patent implements dynamic processing that adapts to the temporal characteristics of each sound source. Fast-transient sources like speech receive quicker processing with shorter analysis windows, while slower sources like music can tolerate longer processing times, optimizing the trade-off between quality and latency for each source type.
Data Source
AI summary
This application relates to a systems and methods for enhanced dynamics processing of streaming audio by source separation and remixing for hearing assistance devices, according to one example. In one embodiment, an external streaming audio device processes sources isolated from an audio signal using source separation, and mixes the resulting signals back into the unprocessed audio signal to enhance individual sources while minimizing audible artifacts. Variations of the present system use source separation in a side chain to guide processing of a composite audio signal.