Dynamic ASR System for Multilingual Edge Speech Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional speech technology and natural language understanding systems face challenges in handling multiple languages and accents, requiring significant computational resources and relying on centralized cloud-based solutions, which limits their deployment on edge devices and introduces bias due to imbalanced training data.

Innovation Solution

A dynamic automatic speech recognition (ASR) system that includes a multilingual dialogue server (MDS) capable of analyzing digital audio input to detect languages and accents, dynamically loading corresponding models for processing, optimizing resource usage, and employing compact AI models to reduce latency and bandwidth requirements, allowing for contactless, multilingual interactions on edge devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional speech technology uses a single monolingual model for speech recognition, then the model size and computational resources required are reduced, but the system cannot handle multiple languages and accents effectively

Engineering Contradiction:
Improvemultilingual supportVSAvoidmodel architecture
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the speech recognition system into multiple language-specific models, each trained on a particular language. A language identification model first determines which language is being spoken, then routes the audio to the corresponding language-specific ASR model. This segmentation allows the system to support multiple languages while keeping each individual model relatively simple and manageable.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a language identification (LangID) model as an intermediary component between the audio input and the speech recognition models. This mediator first analyzes the audio to determine the language being spoken, then selects the appropriate ASR model for that language. This intermediary approach enables multilingual support without requiring a single complex model to handle all languages simultaneously.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If conventional systems use large speech models to achieve accurate speech recognition, then recognition accuracy improves, but the models require expensive cloud-based infrastructure and cannot be deployed on edge devices

Engineering Contradiction:
Improvespeech recognition accuracyVSAvoidcomputational resource consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent applies local quality by deploying language-specific ASR models that are optimized for particular languages and can be selectively executed based on the detected language. This allows the system to use smaller, more efficient models for specific language tasks rather than running a single large universal model, reducing computational resource consumption while maintaining accuracy for each language.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements dynamic model selection where the system adapts its computational resources based on the input language. The language identification model dynamically determines which ASR model to load and execute, allowing the system to optimize resource usage by only activating the necessary model for the current task rather than maintaining all models in active memory simultaneously.

Inventive Principle:
Principle #15Dynamics

3Productivity

If conventional speech models use imbalanced training data weighted toward majority accents, then training efficiency improves, but the models fail for minority accents and languages

Engineering Contradiction:
Improvetraining efficiencyVSAvoidperformance across accents
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent segments the training data into language-specific and accent-specific datasets, creating separate training corpora for different languages and accents. This allows each model to be trained on balanced, representative data for its specific language and accent domain, improving reliability for minority accents while maintaining training efficiency by avoiding the need to process all diverse data in a single model.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the training parameters by creating language-specific and accent-specific training datasets with balanced representations. Instead of using a single imbalanced dataset for all languages, the system trains separate models on curated datasets that are balanced for their specific language and accent domains, improving performance reliability across diverse accents while maintaining training efficiency through specialized, focused training data.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS12198689B1Systems and methods for multilingual dialogue interactions using dynamic automatic speech recognition and processing
Publication Date: 2025.01.14 SUMMER INSTITUTE OF LINGUISTICS INC
  • US12198689B1 patent drawing
  • US12198689B1 patent drawing
  • US12198689B1 patent drawing

AI summary

A system includes a processor; a memory; an electronic network; an application including computing instructions configured to be executed by the processor; and a multilingual dialogue server accessible by the application, comprising a language detection model, and an automatic speech recognition model; wherein the computing instructions of the app, when executed by the one or more processors, are configured to cause the one or more processors to: receive input; analyze the input using the trained model; select a speech model; analyze the input; generate metadata; and transmit the metadata. A method includes receiving input; analyzing the input; selecting a speech model; analyzing the input; generating metadata; and transmitting the metadata. A non-transitory computer readable medium containing program instructions that when executed, cause a computer to: receive input; analyze the input; select a trained speech model; analyze the input; generate metadata; and transmit the metadata.