Dual-Model Pinyin Correction for Accurate Text Transformation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Speech recognition errors due to factors like speaker accent, environmental noise, or homophones in sentence content are amplified and lead to failures in downstream tasks, necessitating effective correction of acoustic model recognition results.

Innovation Solution

A natural language processing model is trained using a first model for pinyin correction and a second model for text transformation, integrating pinyin-to-word transformation, with loss functions and embedded coding to improve accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a single-model approach is used for pinyin-to-word transformation, then the system complexity is low, but the recognition accuracy is insufficient due to speech recognition errors from accents, noise, and homophones

Engineering Contradiction:
Improverecognition accuracyVSAvoidmodel complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent divides the pinyin-to-word transformation task into two separate models: a first model for pinyin correction and a second model for pinyin-to-word transformation. This segmentation allows each model to specialize in its specific function, improving overall accuracy while managing complexity through modular design. The correction model specifically addresses speech recognition errors from accents, noise, and homophones before the transformation model processes the corrected pinyin.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If pinyin correction is performed before transformation, then the recognition accuracy improves, but the processing time and computational resources increase

Engineering Contradiction:
Improverecognition accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary correction action by using the first model to correct pinyin errors before the second model performs pinyin-to-word transformation. This preliminary correction addresses speech recognition errors from accents, noise, and homophones in advance, ensuring that the transformation model receives accurate input. The loss function design with different weights for correction and transformation tasks optimizes the balance between correction accuracy and processing efficiency.

Inventive Principle:
Principle #10Preliminary action

3Manufacturing precision

If multiple loss functions are used for training the dual-model system, then the training precision and correction capability improve, but the training complexity and computational overhead increase

Engineering Contradiction:
Improvetraining precisionVSAvoidtraining complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies different loss functions to different parts of the training process: a first loss function for the correction model and a second loss function for the transformation model. This local quality approach allows each model to be optimized for its specific function with appropriate loss metrics. The correction model's loss function focuses on accuracy while the transformation model's loss function focuses on transformation quality, enabling precise control over each component's training without requiring a single complex unified loss function.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS12525222B2Method of training natural language processing model method of natural language processing, and electronic device
Publication Date: 2026.01.13 BOE TECHNOLOGY GROUP CO LTD
  • US12525222B2 patent drawing
  • US12525222B2 patent drawing
  • US12525222B2 patent drawing

AI summary

The present disclosure relates to a method of training a natural language processing model, a method of natural language processing, and an electronic device. The method of training a natural language processing model includes: acquiring corpus data for training; processing the corpus data by using a natural language processing model to obtain output information, wherein the natural language processing model includes a first model for correcting pinyin data of the corpus data and a second model for performing text transformation on the corrected pinyin data of the corpus data; and training the natural language processing model according to the output information of the natural language processing model to obtain the trained natural language processing model.