Dual-Model Pinyin Correction for Accurate Text Transformation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Speech recognition errors due to factors like speaker accent, environmental noise, or homophones in sentence content are amplified and lead to failures in downstream tasks, necessitating effective correction of acoustic model recognition results.
Innovation Solution
A natural language processing model is trained using a first model for pinyin correction and a second model for text transformation, integrating pinyin-to-word transformation, with loss functions and embedded coding to improve accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a single-model approach is used for pinyin-to-word transformation, then the system complexity is low, but the recognition accuracy is insufficient due to speech recognition errors from accents, noise, and homophones
Solution Approach 1:
The patent divides the pinyin-to-word transformation task into two separate models: a first model for pinyin correction and a second model for pinyin-to-word transformation. This segmentation allows each model to specialize in its specific function, improving overall accuracy while managing complexity through modular design. The correction model specifically addresses speech recognition errors from accents, noise, and homophones before the transformation model processes the corrected pinyin.
2Measurement precision
If pinyin correction is performed before transformation, then the recognition accuracy improves, but the processing time and computational resources increase
Solution Approach 1:
The patent applies preliminary correction action by using the first model to correct pinyin errors before the second model performs pinyin-to-word transformation. This preliminary correction addresses speech recognition errors from accents, noise, and homophones in advance, ensuring that the transformation model receives accurate input. The loss function design with different weights for correction and transformation tasks optimizes the balance between correction accuracy and processing efficiency.
3Manufacturing precision
If multiple loss functions are used for training the dual-model system, then the training precision and correction capability improve, but the training complexity and computational overhead increase
Solution Approach 1:
The patent applies different loss functions to different parts of the training process: a first loss function for the correction model and a second loss function for the transformation model. This local quality approach allows each model to be optimized for its specific function with appropriate loss metrics. The correction model's loss function focuses on accuracy while the transformation model's loss function focuses on transformation quality, enabling precise control over each component's training without requiring a single complex unified loss function.
Data Source
AI summary
The present disclosure relates to a method of training a natural language processing model, a method of natural language processing, and an electronic device. The method of training a natural language processing model includes: acquiring corpus data for training; processing the corpus data by using a natural language processing model to obtain output information, wherein the natural language processing model includes a first model for correcting pinyin data of the corpus data and a second model for performing text transformation on the corrected pinyin data of the corpus data; and training the natural language processing model according to the output information of the natural language processing model to obtain the trained natural language processing model.


