Custom Speech-to-Text Model Training System

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing speech recognition services rely on general-purpose models that fail to provide adequate transcription performance and accuracy for specific domains like legal or finance, as they use a one-size-fits-all approach.

Innovation Solution

A system that allows developers to create and deploy custom speech-to-text models tailored to specific domains, using a provider network with tools for model training and deployment, enabling improved accuracy and performance by leveraging domain-specific data and workflows.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If general-purpose speech-to-text models are used, then device complexity is reduced and ease of operation is improved, but transcription accuracy and performance deteriorate for specific domains

Engineering Contradiction:
Improvetranscription accuracyVSAvoidmodel complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments the speech-to-text modeling task into general-purpose components and domain-specific components. Developers can create custom models by combining pre-trained general models with domain-specific training data and configurations, rather than building entirely custom models from scratch. This segmentation allows high accuracy for specific domains while managing complexity through modular architecture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary action by providing pre-trained speech-to-text models that have already been trained on general speech data. Developers only need to perform additional domain-specific training or fine-tuning rather than starting from scratch, which reduces the complexity of model development while maintaining high transcription accuracy for specific domains.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If custom speech-to-text models are trained for specific domains, then transcription accuracy is improved, but resource requirements and development time increase

Engineering Contradiction:
Improvetranscription accuracyVSAvoidmodel development time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary training on general speech data before domain-specific application. Pre-trained models are made available to developers who only need to perform domain-specific fine-tuning, significantly reducing model development time compared to training from scratch while maintaining high transcription accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system allows developers to copy and adapt pre-trained models for domain-specific use. Instead of creating entirely new models, developers can replicate and modify existing models with domain-specific training data, reducing both development time and computational resources required.

Inventive Principle:
Principle #26Copying

3Measurement precision

If custom speech-to-text models are trained for specific domains, then transcription accuracy is improved, but device complexity and development resources increase

Engineering Contradiction:
Improvetranscription accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments the model creation process into manageable components: base model selection, domain-specific data preparation, training configuration, and deployment. This segmentation reduces system complexity by providing a structured workflow that guides developers through custom model creation without requiring expertise in all aspects of speech recognition system design.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system provides universal tools and platforms that can be used across different domains. The same development platform, training infrastructure, and model architecture can be applied to multiple domains (legal, finance, healthcare, etc.), reducing overall system complexity through reusability and standardization.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11551695B1Model training system for custom speech-to-text models
Publication Date: 2023.01.10 AMAZON TECH INC
  • US11551695B1 patent drawing
  • US11551695B1 patent drawing
  • US11551695B1 patent drawing

AI summary

A transcription service may receive a request from a developer to build a custom speech-to-text model for a specific domain of speech. The custom speech-to-text model for the specific domain may replace a general speech-to-text model or add to a set of one or more speech-to-text models available for transcribing speech. The transcription service may receive a training data and instructions representing tasks. The transcription service may determine respective schedules for executing the instructions based at least in part on dependencies between the tasks. The transcription service may execute the instructions according to the respective schedules to train a speech-to-text model for a specific domain using the training data set. The transcription service may deploy the trained speech-to-text model as part of a network-accessible service for an end user to convert audio in the specific domain into texts.