Email-like Interface for Natural Language Training

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Integrating a natural language system into wearable devices is challenging due to the need for application-specific models that are expensive to build and require large training datasets, making it difficult to accurately process complex natural language requests into actionable commands.

Innovation Solution

A system providing an email-like user interface for configuring and training natural language configuration systems, leveraging a crowd-sourced network of instances to efficiently create customizable systems by processing user logs and predicting user intents, thereby minimizing human interaction and training time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a natural language system is customized for a particular application, then the accuracy of processing natural language expressions is improved, but the cost and time required to build the model increases significantly

Engineering Contradiction:
Improveaccuracy of natural language processingVSAvoidtime to build customized model
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by collecting and storing user logs from multiple sources before customization is needed. These logs are pre-processed and organized into training datasets that can be quickly deployed when application-specific customization is required, eliminating the need for time-consuming data collection and model building from scratch

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates copies of general natural language processing models and adapts them for specific applications using pre-collected user logs. Instead of building entirely new customized models, the system copies existing models and fine-tunes them with application-specific training data, significantly reducing the time and resources required for customization

Inventive Principle:
Principle #26Copying

2Measurement precision

If a natural language system is customized for a particular application, then the accuracy of processing natural language expressions is improved, but the cost of building the model increases

Engineering Contradiction:
Improveaccuracy of natural language processingVSAvoidcost to build customized model
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The system merges user logs from multiple applications and sources into a centralized repository. This consolidation allows the system to create comprehensive training datasets that can be shared across multiple applications, reducing the overall cost of building customized models by avoiding redundant data collection and processing for each individual application

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system builds a universal natural language processing model that can be adapted to multiple applications through fine-tuning with specific training data. This multi-functional approach allows a single base model to serve multiple purposes, reducing the cost of developing application-specific models compared to building separate customized models for each application

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If a large training data set is used to train the natural language interface, then the accuracy of processing complex natural language requests is improved, but the time and resources required for training increases

Engineering Contradiction:
Improveaccuracy of natural language processingVSAvoidtraining speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system performs preliminary data processing by collecting, cleaning, and organizing user logs into ready-to-use training datasets before the training phase. This pre-processing work is done in advance using automated scripts and tools, so that when training is initiated, the data is already prepared and can be loaded efficiently, reducing the overall training time while maintaining data quality

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system segments the large training dataset into smaller, manageable chunks or batches that can be processed in parallel. This segmentation allows the training process to utilize multiple computing resources simultaneously, significantly reducing the time required to train on large datasets while still achieving high model accuracy through comprehensive coverage of training examples

Inventive Principle:
Principle #1Segmentation

4Ease of operation

If generic natural language models are used, then the ease of implementation is improved, but the accuracy for application-specific contexts deteriorates

Engineering Contradiction:
Improveease of implementationVSAvoidaccuracy in application-specific context
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system implements a dynamic model selection and adaptation mechanism that allows the natural language processing system to transition from generic to application-specific models based on the context. The system can dynamically load and switch between different trained models or fine-tune a base model with application-specific data when needed, providing both ease of implementation through generic models and high accuracy through specialized models when required

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10978052B2Email-like user interface for training natural language systems
Publication Date: 2021.04.13 META PLATFORMS INC
  • US10978052B2 patent drawing
  • US10978052B2 patent drawing
  • US10978052B2 patent drawing

AI summary

An email-like user interface displays a list of user logs determined based on user-specified list criteria to user logs received in a natural language (NL) training environment. The list comprise a subset of the received user logs in order to minimize the number of actions required to configure and train the NL configuration system in a semi-supervised manner, thereby improving the quality and accuracy of NL configuration system. To determine a list of user logs relevant for training the user logs can be filtered, sorted, grouped and searched within the email-like user interface. A training interface to a network of instances that comprises a plurality of NL configuration systems leverages a crowd-sourcing community of developers in order to efficiently create a customizable NL configuration system.