Audio frequency-based man-machine mixed interaction system and method

Abstract

The invention discloses an audio frequency-based man-machine mixed interaction system, a voice recognition module and a semantic recognition module are interconnected and used for transmitting word information corresponding to voice, an exception handling module is connected with the voice recognition module and the semantic recognition module, the voice recognition module is used for transmitting the word information to the exception handling module, the semantic recognition module is used for transmitting semantic parsing results to the exception handling module, and the exception handling module and a voice synthesis module are interconnected and used for transmitting intervention information. The invention also discloses an audio frequency-based man-machine mixed interaction method, voice information is converted into the word information via the voice recognition module, the word information is output to a semantic recognition unit, a user aim and corresponding key information are extracted from the word information via the semantic recognition unit, and whether anomaly occurs during a current human computer dialogue is determined by the exception handling module according to the word information of the voice recognition module and semantic information of the semantic recognition module, and an information reply for the anomaly is given. The audio frequency-based man-machine mixed interaction system and method disclosed in a technical solution of the invention can provide unified human computer dialogue experience.

Description

technical field [0001] The present invention relates to the technical field of information processing, in particular to an audio-based human-computer hybrid interaction system and method. Background technique [0002] Such as figure 1 As shown, the current audio-based man-machine dialogue systems all use the machine reply as the final reply to present to the user. When the machine decision-making system cannot clarify the user's intention, most dialogue systems choose to present a reply such as "please say it again" to let the user Carry out re-input, and some of the man-machine dialogue systems introduce a manual intervention method based on the call center. [0003] At present, the abnormal handling of the existing human-machine dialogue is mainly realized through the call center. When the machine cannot process the user input audio or when the user clearly expresses the need for manual service, the call center is requested to intervene manually. At this time, a pair is e...

AI Technical Summary

Problems solved by technology

[0004] The problems existing in the manual intervention method of the existing call center mainly include: low manual efficiency, the interventionist and the user need to establish one-to-one voice communication, and cannot serve other people during the time period waiting for user input; high cost, large-scale The call center requires a series of telecommunication equipment and corresponding service integration. At the same time, due to low efficiency, more interventionists are required to provide intervention services, which indirectly increases labor costs; it is greatly affected by the network environment: using network resources to directly transmit audio requires a stable network Connection, the fluctuation of the network environment will lead to the decline of audio quality, which will affect the dialogue experience, and even interrupt the process of man-machine dialogue

Images