2 results about "Phoneme recognition" patented technology

The application discloses a spoken language evaluation system and method based on multiple dimensions, and relates to the technical field of data processing.The system comprises the following steps: obtaining audio text, a phoneme list and a phoneme time boundary list corresponding to speech data according to a pre-trained text phoneme recognition model; calculating a fluency score according to the phoneme list and the phoneme time boundary list; obtaining a semantic score of the audio text through a pre-trained semantic model; obtaining a syntax score of the audio text through a pre-trained syntax model; matching the audio text and an answer text according to a text matching method based on an edit distance to obtain a text matching score; obtaining a pronunciation score of the audio data finally through phoneme confidence of the phoneme list; dynamically adjusting the weight of each dimension score according to the length of the audio text, and calculating a final spoken language evaluation score; and the application comprehensively evaluates the spoken language ability through multi-dimensional evaluation and dynamic weight adjustment according to the scene, and realizes the comprehensiveness, fairness, accuracy and high efficiency of the spoken language evaluation.

This application provides a digital human mouth shape driving method, system, and medium based on phoneme recognition. The method includes: acquiring input raw speech signals and processing the raw speech signals; performing feature extraction and phoneme recognition on preprocessed data information to obtain accurate phoneme category and time sequence information; constructing a preset phoneme and mouth shape parameter mapping library, the mapping library including mouth shape parameters and muscle deformation parameters corresponding to different phonemes and different pronunciation styles; dynamically matching the phoneme time sequence information with the mapping library to obtain corresponding mouth shape driving parameters and muscle deformation parameters; inputting a digital human mouth and surrounding muscle model, driving the model to deform, obtaining the driving result, and performing synchronous processing of mouth shape and speech pronunciation on the model to obtain synchronization result information; through phoneme-level fine-grained recognition, dynamic mapping matching, and precise driving of muscle models, real-time synchronization of mouth shape and speech pronunciation is achieved, improving the naturalness and realism of digital human voice interaction.