Recurrent Neural Network Text Error Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional text error correction methods rely heavily on feature designs driven by data and lack contextual syntax information, resulting in poor accuracy and limited scalability, failing to meet user expectations.

Innovation Solution

A text error correction method using a trained recurrent neural network model that combines contextual syntax information to improve accuracy, involving the acquisition and processing of text data to generate error-corrected text, with options for training using long short-term memory or bi-directional recurrent neural networks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional machine learning methods with feature designs are used, then the system can process text data, but error correction accuracy is poor due to lack of contextual syntax information

Engineering Contradiction:
Improveerror correction accuracyVSAvoidcontextual syntax information
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent transitions from traditional feature-based processing to recurrent neural networks that process text in sequential dimensions, capturing contextual syntax information through time-dependent relationships. The RNN architecture adds a temporal dimension to text processing, allowing the model to understand context across multiple tokens rather than treating each token independently.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent changes the fundamental parameters of text processing by using learned embeddings and neural network weights instead of hand-crafted features. The model learns optimal representations of text data through training, dynamically adjusting parameters to capture contextual patterns that improve error correction accuracy.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If traditional statistical machine translation methods are used, then the processing approach is simple, but the model has poor universality and cannot be used on a large scale

Engineering Contradiction:
Improvemodel universalityVSAvoidmodel complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a universal text error correction model using recurrent neural networks that can handle multiple languages and text types. The RNN architecture with learned embeddings provides a flexible framework that adapts to different domains and languages through training data, rather than requiring language-specific or domain-specific feature engineering.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent replaces traditional mechanical feature engineering approaches with neural network-based automatic feature learning. Instead of manually designing features based on linguistic rules, the model automatically learns relevant features from data, substituting manual mechanical processes with automated computational processes.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Reliability

If conventional methods with high data normalization requirements are used, then processing is straightforward, but the system cannot handle sparse data effectively

Engineering Contradiction:
Improveperformance on sparse dataVSAvoiddata normalization requirement
Core Design Contradiction:
ReliabilityVSEase of manufacture

Solution Approach 1:

The patent applies preliminary embedding layer transformations that map discrete text tokens into continuous vector spaces before processing. This preliminary action converts sparse categorical data into dense numerical representations, enabling the model to handle sparse data effectively by learning meaningful relationships in the embedding space during training.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11314921B2Text error correction method and apparatus based on recurrent neural network of artificial intelligence
Publication Date: 2022.04.26 BAIDU ONLINE NETWORK TECH (BEIJIBG) CO LTD
  • US11314921B2 patent drawing
  • US11314921B2 patent drawing

AI summary

A text error correction method and a text error correction apparatus based on a recurrent neural network of artificial intelligence are provided. The method includes: acquiring text data to be error-corrected; performing error correction on the text data to be error-corrected by using a trained recurrent neural network model so as to generate error-corrected text data.