Speech Signal Ensemble Learning for Noise Interference

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing speech enhancement methods face challenges in improving speech quality and intelligibility in noisy environments due to varied interference types and operational constraints, often improving one aspect of the signal while deteriorating others, and struggle to accommodate complex models in real-time applications.

Innovation Solution

The method combines multiple acoustic signal enhancement procedures within an ensemble learning framework, processing signals to produce initial enhanced signals, which are then combined using ensemble learning to determine features, effectively enhancing speech signals by constructing representations in a common domain to resemble a clean target signal.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a simple enhancement method is used, then computational resources and latency constraints are satisfied, but the method cannot accommodate the variety of interference conditions

Engineering Contradiction:
Improvereal-time processing capabilityVSAvoidaccommodation of diverse interference types
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The enhancement system is divided into multiple independent enhancement procedures, each specialized for different interference conditions. These procedures operate in parallel and their outputs are combined through voting, allowing the system to handle diverse interference types while maintaining real-time performance through efficient resource utilization.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Multiple enhancement procedures are merged into an ensemble system where their outputs are combined through voting mechanisms. This merging allows the system to leverage the strengths of each individual procedure for different interference conditions, achieving both versatility and real-time performance.

Inventive Principle:
Principle #5Merging (Combining)

2Ease of operation

If a single enhancement method is used, then the system is simple to operate, but it improves some parts of the signal while deteriorating others

Engineering Contradiction:
Improvesystem simplicityVSAvoidsignal enhancement quality
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The system implements voting feedback mechanisms where multiple enhancement procedures provide their estimates, and the final output is determined by combining these estimates through voting. This feedback loop allows the system to correct individual procedure errors and improve overall signal enhancement quality while maintaining operational simplicity.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The enhancement system uses a composite approach by combining multiple enhancement procedures with different characteristics. Each procedure contributes its strengths to the final enhanced signal, similar to how composite materials combine different materials to achieve superior properties, thereby improving overall signal quality without complicating operation.

Inventive Principle:
Principle #40Composite materials

3Adaptability or versatility

If complex models are used to represent and adapt to many different interferences, then adaptability improves, but operational constraints on computational resources and latency are violated

Engineering Contradiction:
Improveadaptation to multiple interference typesVSAvoidcomputational model complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The complex adaptation problem is segmented into multiple simpler enhancement procedures, each adapted to specific interference conditions. This segmentation allows the system to achieve high adaptability through the collection of specialized procedures rather than through a single complex model, satisfying computational resource constraints.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system adapts to different interference conditions by changing the composition and weighting of the ensemble of enhancement procedures rather than using a single complex model with many parameters. This approach achieves adaptability through parameter changes in the ensemble configuration, maintaining lower computational complexity.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS9601130B2Method for processing speech signals using an ensemble of speech enhancement procedures
Publication Date: 2017.03.21 MITSUBISHI ELECTRIC RESEARCH LABORATORIES INC
  • US9601130B2 patent drawing
  • US9601130B2 patent drawing
  • US9601130B2 patent drawing

AI summary

A method processes an acoustic signal that is a mixture of a target signal and interfering signals by first enhancing the acoustic signal by a set of enhancement procedures to produce a set of initial enhanced signals. Then, an ensemble learning procedure is applied to the acoustic signal and the set of initial enhancement signals to produce features of the acoustic signal.