Context-Aware Language Model Adjustment for Speech Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current speech recognition systems face challenges in accurately transcribing speech in varying contexts due to the lack of adaptation to specific environments, user preferences, and contextual information, leading to suboptimal performance in selecting appropriate transcriptions.

Innovation Solution

A method that adjusts a language model based on contextual information, including geographic location, document type, and user-specific data, by determining similarity scores between the context of the audio data and previously entered terms, thereby increasing the probability of selecting relevant transcriptions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a standard language model is used for speech recognition, then the system is simple and fast to operate, but the transcription accuracy decreases in varying contexts

Engineering Contradiction:
Improvetranscription accuracyVSAvoidlanguage model complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The language model is made dynamic by adjusting weighting values of terms based on contextual similarity scores. The system continuously adapts the language model to match the current context (geographic location, document type, user habits) rather than using a static model, thereby improving transcription accuracy without requiring a completely separate model for each context.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the parameters of the language model by modifying weighting values of terms based on similarity scores between current context and historical contexts. This parameter adjustment allows the same language model to adapt to different contexts, improving accuracy while avoiding the complexity of maintaining multiple separate models.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If context-based adjustment is applied to the language model, then transcription accuracy improves, but the processing time and computational complexity increase

Engineering Contradiction:
Improvetranscription accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

Context information (geographic location, document type, user habits) is collected and stored in advance before speech recognition occurs. The system pre-processes and stores contextual data so that when speech recognition is needed, the language model can be quickly adjusted using pre-computed similarity scores rather than analyzing context from scratch.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses feedback from user corrections and confirmations to continuously refine the language model adjustments. By incorporating user feedback loops, the system learns from interactions and improves transcription accuracy over time without requiring excessive processing for each individual speech input.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9542945B2Adjusting language models based on topics identified using context
Publication Date: 2017.01.10 GOOGLE LLC
  • US9542945B2 patent drawing
  • US9542945B2 patent drawing
  • US9542945B2 patent drawing

AI summary

Methods, systems, and apparatuses, including computer programs encoded on a computer storage medium, for adjusting language models. In one aspect, a method includes accessing audio data. Information that indicates a first context is accessed, the first context being associated with the audio data. At least one term is accessed. Information that indicates a second context is accessed, the second context being associated with the term. A similarity score is determined that indicates a degree of similarity between the second context and the first context. A language model is adjusted based on the accessed term and the determined similarity score to generate an adjusted language model. Speech recognition is performed on the audio data using the adjusted language model to select one or more candidate transcriptions for a portion of the audio data.