Text Prediction Engine With Multiple Language Models

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current text input methods for electronic devices, such as QWERTY-style keyboards and handwriting recognition, are limited in efficiency and accuracy, particularly in noisy environments, and do not effectively adapt to user-specific language patterns or contexts.

Innovation Solution

A system utilizing a text prediction engine with multiple language models, including human language, application-specific, and user-specific models, that generates concurrent predictions in real-time, combining probabilistic and n-gram language models to provide adaptive and context-aware word or phrase suggestions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional dictionary-based text prediction systems are used, then text input efficiency is improved through predictions, but the system cannot adapt to user-specific language patterns or contextual nuances

Engineering Contradiction:
ImproveAdaptability to user-specific language patternsVSAvoidComplexity of language model system
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The language model system is segmented into multiple independent models (e.g., unigram, bigram, trigram models) that can be selectively applied. Each model captures different aspects of language patterns, allowing the system to adapt to user-specific patterns without requiring a single monolithic complex model.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically selects and weights different language models based on the current context and input sequence. This dynamic adaptation allows the system to adjust to user-specific patterns in real-time without requiring complete reconfiguration, balancing adaptability with operational simplicity.

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If multiple language models are used to generate concurrent predictions, then prediction accuracy and context-awareness are improved, but computational complexity increases

Engineering Contradiction:
ImprovePrediction accuracyVSAvoidComputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system computes predictions using multiple language models but selectively applies them based on confidence thresholds and context relevance. Not all models are fully evaluated for every input - the system performs partial computations when simpler models suffice, reducing overall computational complexity while maintaining accuracy.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The language models operate continuously in parallel, generating predictions for each input sequence without interruption. This continuous operation allows the system to maintain high prediction accuracy through multiple concurrent evaluation streams while optimizing resource utilization through efficient parallel processing.

Inventive Principle:
Principle #20Continuity of useful action

3Productivity

If real-time concurrent predictions are generated, then user input efficiency is improved, but processing time and computational resources increase

Engineering Contradiction:
ImproveText input efficiencyVSAvoidProcessing time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system pre-computes and caches language model statistics and prediction probabilities during system initialization and updates. This preliminary action allows real-time prediction generation to rely on pre-processed data, significantly reducing the computational burden and processing time during actual text input operations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements early termination of prediction generation when high-confidence predictions are obtained from simpler language models. If unigram or bigram models provide sufficiently accurate predictions, the system skips more computationally intensive trigram or context-aware model evaluations, reducing processing time while maintaining efficiency.

Inventive Principle:
Principle #21Skipping (Rushing through)

Data Source

PatentUS11416679B2System and method for inputting text into electronic devices
Publication Date: 2022.08.16 MICROSOFT TECHNOLOGY LICENSING LLC
  • US11416679B2 patent drawing
  • US11416679B2 patent drawing
  • US11416679B2 patent drawing

AI summary

The present invention provides a system comprising a user interface configured to receive text input by a user, a text prediction engine comprising a plurality of language models and configured to receive the input text from the user interface and to generate concurrently text predictions using the plurality of language models, and wherein the text prediction engine is further configured to provide text predictions to the user interface for display and user selection. An analogous method and an interface for use with the system and method are also provided.