Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Microphone array voice reinforcing system and microphone array voice reinforcing method with combination of audio information and video information

A microphone array and speech enhancement technology, which is applied in speech analysis, instruments, character and pattern recognition, etc., can solve problems such as easy error judgment in direction of arrival estimation, low voice quality, inconvenient monitoring, etc.

Active Publication Date: 2017-01-11
SOUTH CHINA UNIV OF TECH
View PDF8 Cites 51 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the existing microphone array speech enhancement technologies are all based on air-conduction speech sensors, which have the following deficiencies in practical applications: (1) when the environmental noise is strong, the output speech quality is not high; (2) when the environment is used When there are multiple sound sources in the environment,

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Microphone array voice reinforcing system and microphone array voice reinforcing method with combination of audio information and video information
  • Microphone array voice reinforcing system and microphone array voice reinforcing method with combination of audio information and video information
  • Microphone array voice reinforcing system and microphone array voice reinforcing method with combination of audio information and video information

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0048] The specific implementation steps of the present invention will be further described below in conjunction with the accompanying drawings and embodiments, but the embodiments of the present invention are not limited thereto.

[0049] The system structure of the embodiment of the present invention is as figure 1 As shown, it is composed of a video acquisition module, a microphone array receiving module, an audio and video direction of arrival joint estimation module, a microphone array speech enhancement module, and an audio and video joint speech enhancement module, wherein the video acquisition module and the audio and video arrival direction joint estimation module , audio and video joint voice enhancement module, used to collect the video signal of the speaker in the application scene; the microphone array receiving module is connected to the joint estimation module of the direction of arrival of audio and video, and the microphone array voice enhancement module, used ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a microphone array voice reinforcing system and a microphone array voice reinforcing method with combination of audio information and video information. The system comprises a video acquisition module, a microphone array receiving module, an audio-and-video incoming wave direction combined-estimation module, a microphone array voice reinforcing module and an audio-and-video combined voice reinforcing module. The video acquisition module is used for acquiring a video signal of a speaker in an application scene. The microphone array receiving module is used for receiving an audio signal of a speaker. The audio-and-video incoming wave direction combined-estimation module performs combined estimation for the audio incoming wave direction of the speaker by means of audio information and video information. The microphone array voice reinforcing module utilizes the audio signal which is received by the microphone array receiving module for reinforcing a voice signal. The audio-and-video combined voice reinforcing module performs secondary reinforcing on the voice by means of combination of the audio signal and the video signal. According to the microphone array voice reinforcing system and the microphone array voice reinforcing method, the performance of the microphone array voice reinforcing system can be remarkably improved. The microphone array voice reinforcing system and the microphone array voice reinforcing method can be widely used for occasions of a video conference, an on-vehicle telephone, a mobile video communication terminal, etc.

Description

technical field [0001] The invention relates to the field of speech signal processing, in particular to a microphone array speech enhancement system for fusion of audio and video information. Background technique [0002] In the actual use environment, the communication equipment is susceptible to interference such as background noise and reverberation, which affects the quality and intelligibility of the voice signal. Therefore, in many communication applications, effective voice enhancement processing is required to suppress noise and improve voice. Clarity, intelligibility and comfort. [0003] At present, the commonly used speech enhancement methods mainly include two categories. One is the speech enhancement method based on a single microphone, including spectral subtraction, Wiener filter, MMSE, Kalman filter, wavelet transform, etc. This type of method uses a single microphone to receive speech signals. The noise is suppressed by filtering and processing in the time ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G10L21/0216G06K9/00
CPCG10L21/0216G10L2021/02166G06V40/162G06V40/165
Inventor 张军陈鑫源宁更新冯义志季飞余华陈芳炯
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products