Speech separation and tracking method for public security criminal investigation and monitoring

Abstract

The invention relates to the technical field of speech signal recognition and processing, and provides a speech separation and tracking method for public security criminal investigation and monitoring. The speech separation and tracking method includes the following steps that initial speech is imported according to timing sequence, the initial speech is subjected to framing and windowing processing, and a windowed speech signal is obtained; the windowed speech signal is time-frequency decomposed, and a time-frequency two-dimensional signal is obtained by the short-time Fourier transform; an endpoint of the time-frequency two-dimensional signal is detected in a frequency domain, and a corresponding speech signal segment of an empty language segment is filtered; a bidirectional long and short time memory network structure is used for performing speech separation of the two filtered dimensional time-frequency signal, and a great deal of speech waveform of a target speaker are output; anda target speaker model based on GMM-UBM is established and trained, the speech waveform of the target speaker are taken as models and input, a GMM model of the target speaker is acquired through an adaptive method and the speech waveform are recognized, a sequence number of the target speaker is outputted, that is, a speech tracking result.

Description

technical field [0001] The invention relates to the technical field of voice signal recognition and processing, and more specifically, to a voice separation and tracking method for public security criminal investigation monitoring. Background technique [0002] In the field of public security criminal investigation and monitoring, it is difficult to obtain relevant important information for the audio clip because the obtained audio clip contains related interference factors such as background noise, multiple speakers, and reverberation. Therefore, in the process of processing the speech signal, it is necessary to separate the speech signals of multiple speakers before processing them separately. At the same time, due to the particularity of criminal investigation monitoring, the voice signals of multiple speakers are collected by the same pickup, so it is difficult to separate and process the voice signals of multiple speakers. In addition, in the actual monitoring process ...

AI Technical Summary

Problems solved by technology

[0004] 1. Align and capture the position information of multiple target speakers through the combination of multiple microphone arrays, but this method has problems of nonlinear combination of multiple microphones and configuration stability;

[0005] 2. Use visual information as auxiliary information to enhance the performance of the speech separation and tracking system to separate and track speech signals. However, this method needs to combine speech information and visual information for simultaneous processing and analysis, and in practical applic

Images