EEG-Assisted Binaural Beamformer for Speech Enhancement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing ear-mounted hearing systems face challenges in accurately distinguishing speech from noise in noisy environments due to the sensitivity of EEG-based attention decoding and the need for additional blind source separation processes, leading to incorrect talker suppression and complex signal processing demands.
Innovation Solution
An EEG-assisted binaural beam former is integrated into an optimization model to directly utilize attention information from EEG signals, eliminating the need for separate attention decoding and blind source separation, using iterative algorithms like Gradient Projection Method and Alternating Direction Method of Multipliers to compute beam-forming weight coefficients for effective speech enhancement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If EEG-based attention decoding is used to identify target talkers, then speech enhancement capability is improved, but sensitivity to wrong attention decoding causes incorrect talker suppression
Solution Approach 1:
The patent combines attention decoding and beam forming into a unified joint optimization model, merging previously separate processing stages. This integration allows the system to simultaneously optimize both attention estimation and spatial filtering, preventing error propagation from attention decoding to beam forming, and eliminating incorrect talker suppression by considering both objectives together rather than sequentially.
Solution Approach 2:
The joint optimization model incorporates feedback mechanisms where the beam forming output influences attention decoding and vice versa. The model uses the correlation between EEG-derived attention and beam forming output as a feedback signal to iteratively refine both components, ensuring that attention decoding is guided by actual speech enhancement effectiveness rather than relying solely on potentially erroneous EEG interpretations.
2Loss of information
If separate attention decoding and blind source separation processes are implemented, then speech source information is extracted, but processing complexity increases
Solution Approach 1:
The patent merges attention decoding and blind source separation into a single joint optimization framework. Instead of implementing separate processing pipelines that require multiple independent algorithms and parameter settings, the unified model simultaneously performs both functions through a single optimization process, significantly reducing computational complexity while maintaining the ability to extract speech source information from EEG signals.
Solution Approach 2:
The joint optimization model serves multiple functions simultaneously: it performs attention decoding, blind source separation, and beam forming weight calculation in a single unified framework. This multi-functional approach eliminates the need for separate specialized processors for each task, reducing overall system complexity while preserving all necessary information extraction capabilities.
Data Source
AI summary
Disclosed is a multi-mode beam former, comprising a device for receiving a multi-mode input signal, and a device for constructing an optimization model and solving the optimization model to obtain a beam-forming weight coefficient for performing linear or non-linear combination on the multi-mode input signal. The optimization model comprises an optimization formula for obtaining the beam-forming weight coefficient. The optimization formula comprises: establishing an association between at least one electroencephalogram signal and a beam forming output, and optimizing the association to construct the beam-forming weight coefficient associated with the at least one electroencephalogram signal.