The invention relates to the technical field of voice
processing, in particular to a real-time voice synthesis and
conversion method in an intelligent voice call
system, which comprises the following steps of: acquiring
voice data input by a user through a voice recognition module, preprocessing the
voice data, performing semantic analysis through a bidirectional
recurrent neural network and an attention mechanism, and obtaining a semantic analysis result; the method comprises the following steps: extracting a key semantic unit, selecting a proper voice
template based on user historical interaction data and an adaptive
template matching algorithm, performing voice synthesis by using a
generative adversarial network, realizing cross-language or dialect real-time voice conversion through a multi-
task learning algorithm, and combining phoneme-level optimization
processing to ensure the naturalness and continuity of the voice, so as to improve the voice conversion efficiency. And through real-time analysis and a self-adaptive adjustment mechanism fed back by the user, the voice output quality is optimized, and the user experience is improved. According to the invention, efficient and natural
speech synthesis and conversion services can be provided in various intelligent devices and application scenarios, and complex requirements in different language environments can be met.