Voice Recognition Model Training via Negative Sample Path Constraints

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current voice recognition technologies, particularly those using Neural Network Language Models (NNLM), suffer from inaccurate results due to the lack of mandatory constraints on decoding paths, leading to unexpected recognition outputs.

Innovation Solution

A voice recognition model training method that constructs negative samples based on positive samples to constrain the voice decoding path, thereby suppressing unexpected recognition results and improving accuracy by training a second voice recognition model under these constraints.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If voice recognition is performed without constraints on decoding path, then the recognition process is simple and fast, but the recognition accuracy is low due to unexpected outputs

Engineering Contradiction:
Improvevoice recognition accuracyVSAvoiddecoding path constraint complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by constructing negative samples in advance based on positive samples before actual voice recognition. These pre-constructed negative samples are used to train the voice recognition model, enabling it to learn constraints on decoding paths beforehand. This allows the model to avoid unexpected outputs during actual recognition without adding complex real-time constraints during decoding.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements feedback by using the voice recognition model to generate predictions, then comparing these predictions against the pre-constructed negative samples. The model receives feedback in the form of loss calculations based on whether predictions match expected positive samples or incorrectly match negative samples. This feedback loop continuously refines the model's decoding path constraints during training.

Inventive Principle:
Principle #23Feedback

2Reliability

If negative samples are constructed for all possible paths, then the constraint on voice decoding path is comprehensive, but the data processing complexity and storage requirements increase significantly

Engineering Contradiction:
Improvedecoding path constraint reliabilityVSAvoiddata processing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies local quality by constructing negative samples selectively rather than universally for all possible paths. Instead of creating exhaustive negative samples for every potential decoding path, the method focuses on constructing negative samples based on actual positive samples in the training data. This localized approach creates constraints where they are most needed while avoiding unnecessary complexity in less critical areas.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent uses partial action by constructing negative samples only for the specific positive samples present in the training data, rather than attempting to cover all possible voice recognition scenarios. This partial coverage is sufficient to provide effective constraints on decoding paths while keeping the data processing complexity manageable. The approach recognizes that covering all possible paths would be excessive and unnecessary.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS20240221727A1Voice recognition model training method, voice recognition method, electronic device, and storage medium
Publication Date: 2024.07.04 BEIJING BAIDU NETCOM SCI & TECH CO LTD
  • US20240221727A1 patent drawing
  • US20240221727A1 patent drawing
  • US20240221727A1 patent drawing

AI summary

The present disclosure provides a voice recognition model training method and apparatus, an electronic device and a storage medium, relating to the field of artificial intelligence technology, and in particular to the fields such as deep learning and voice recognition. The specific implementation scheme includes constructing a negative sample according to a positive sample to obtain a target negative sample for constraining a voice decoding path; obtaining training data according to the positive sample and the target negative sample; and training a first voice recognition model according to the training data to obtain a second voice recognition model.