Directional pickup method, system and device and storage medium

By performing MVDR beamforming and feature extraction on the initial speech signal input from the microphone array, combining speech/noise separation DNN and adaptive comb filter, Bark gain coefficient is designed, which solves the problem of poor noise suppression effect in the prior art, and achieves more efficient voice signal enhancement and sound pickup effect.

CN119694333AActive Publication Date: 2025-03-25SHANGHAI HAOYI INFORMATION SCI & TECH CO LTD
6 Cites 4 Cited by

Patent Information

Application Number
CN202510215640.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-02-26
Publication Date
2025-03-25
Estimated Expiration
2045-02-26

AI Technical Summary

Technical Problem

The prior art has limited effects in suppressing background noise and reverb, resulting in poor sound pickup.

Method used

A directional sound pickup method is adopted to perform MVDR beamforming processing on the initial speech signal input from the microphone array, extract the target speech signal, and combine the BFCC characteristics and the fundamental tone frequency characteristics, use the pre-trained speech/noise separation DNN for time-frequency masking, design an adaptive comb filter and Bark gain coefficient to perform enhanced speech signal processing.

Benefits of technology

Effectively suppress noise interference in non-target directions, improve the clarity and intelligibility of voice signals, and significantly improve the quality of voice interaction and remote communication.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

The invention provides a directional pickup method, system and device and a storage medium, and relates to the field of pickup. The method comprises the following steps: performing MVDR beam forming processing on an initial voice signal input by a microphone array, and then extracting a BFCC feature and a fundamental tone frequency feature of the voice signal; and processing the BFCC features by using a pre-trained voice / noise separation DNN to obtain a time-frequency mask. And according to the fundamental tone frequency characteristics, adaptively designing comb filter parameters, and carrying out comb filtering on the initial voice signal. And taking the time-frequency mask as a weighting coefficient, respectively multiplying the weighting coefficient with the voice signal after comb filtering and the initial voice signal, and estimating target voice energy and noise energy. And calculating a Bark gain coefficient related to the frequency on the Bark frequency scale, wherein the Bark gain coefficient is used for enhancing the voice signal in the time-frequency domain. And finally, converting the enhanced voice signal into a time domain signal through inverse BFCC conversion to obtain a target enhanced voice pointing to the target direction. Through the scheme, the directional pickup effect is improved.
Need to check novelty before this filing date? Find Prior Art