A real-time role-based transcription method, device and system

Abstract

The invention discloses a real-time role-based transcription method, which includes detecting whether the collected left-channel sound signal and right-channel sound signal contain a speech segment, and if the speech segment is detected, extracting the left-channel speech corresponding to the speech segment segment and the right channel speech segment; based on the phase difference, amplitude difference and fundamental frequency detection of the left channel speech segment and the right channel speech segment, it is judged whether the speech is on both sides; if it is one-sided speech, it is judged whether the speaker is on the side or the right side; if the speaker is on the left side, the left channel speech segments are clustered to form the left cluster center; if the speaker is on the right side, the right channel speech segments are clustered to form the right clustering center Class center; if it is a double-sided speech, separate the left and right side speech signals contained in the left channel speech segment and the right channel speech segment; and send the separated left speech signal and right speech signal to the speech recognition engine; This method can achieve accurate separation of characters. The invention also discloses a real-time role-based transcription device and system.

Description

technical field [0001] The invention relates to the technical field of speech recognition, in particular to a real-time role-based transcription method, device and system. Background technique [0002] Nowadays, in the process of one-to-one window service, the service quality requirements for customer service are getting higher and higher. In such occasions (such as telecom business halls and automobile 4S stores), customer service and customers are often located on the inside and outside of the service counter or window. , to carry out one-on-one dialogue service activities; now there are various assessments on the service quality of customer service, including service words, professional terminology expressions, service attitudes, emotions, and whether to guide customers correctly. The content is clearly collected, and the back-end is used for speech recognition. The back-end processing generally uses a real-time transcription system, and then organizes and analyzes the tr...

AI Technical Summary

Problems solved by technology

[0003] The current front-end voice collection is often based on deep learning solutions or requires the use of front-end recognition equipment; deep learning-based solutions require a local or cloud voice recognition server to perform voice-to-text transcription on the voice streams collected in real time. In addition to identification, roles often need to be processed in the cloud. It is an end-to-end one-stop solution. This solution is not suitable for simple conversations between the two parties. It is generally suitable for meetings where multiple people speak mode; and this solution has high requirements for the hardware configuration of the cloud or local speech recognition engine, the accuracy of role classification is related to the frequency of the speaker, if in some scenarios, a speaker simply said "yes" , "Okay", and there is no speech in the whole speaking process. At this time, the accuracy of role classification is very low. Therefore, this scheme adopts a large and comprehensive scheme to solve some specific problems, and its existence cannot be analyzed locally. The specific situation to do very specific corresponding defects

[0004] With the help of front-end recognition equipment, microphone arrays are generally used to form two directions of 180 degrees to each other. When transcribing, the two speakers need to speak face to face. The device is placed in the center of the connection between the two parties, which makes people feel unfriendly. The voices collected at both ends are compared in real time. Generally, a solution with a high real-time volume is adopted to determine the voice stream of a certain character; There is often no way to deal with the scene of speaking. This solution is to judge the energy of the speakers at both ends. Which side has the loudest volume will classify the voice as that side. If one side is not a voice but a loud volume If there is no noise, the "speaking right" will be taken to this side by mistake; if the speakers at both ends speak at the same time, the strategy adopted in this scheme is to always select the loud voice on one side and keep it until the end. This is a simple and rude behavior. This solution does not have a good estimate of the problem that this kind of "simultaneous speaking" should be treated specially, and there is a defect that it cannot perform special treatment on "simultaneous speaking", and cannot obtain a better recognition effect

Images