Hybrid NLU System for Conversational Applications

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current conversational systems struggle to achieve deep and broad natural language understanding, relying heavily on either rule-based or data-driven approaches, which have limitations in precision, robustness, and user trust, lacking a combination that provides both fine-grained and broad interpretation.

Innovation Solution

A hybrid approach combining rule-based and data-driven methods for natural language understanding, using pre-built building blocks for automatic generation and optimization, incorporating unsupervised statistical computing for linguistic pattern recognition, and integrating machine learning models for improved accuracy and control.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If rule-based approaches are used for natural language understanding, then manufacturing precision is improved, but device complexity increases

Engineering Contradiction:
Improvenatural language understanding precisionVSAvoidsystem complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system segments natural language understanding into multiple specialized modules including intent recognition, entity extraction, and context analysis. Each module handles specific aspects of NLU independently, improving overall precision while distributing complexity across modular components rather than a monolithic system.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces intermediary components such as language models and knowledge graphs that mediate between raw user input and the rule-based processing system. These intermediaries pre-process and structure unstructured language data, reducing the complexity burden on the core rule-based NLU engine while maintaining high understanding precision.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If data-driven approaches are used for natural language understanding, then adaptability is improved, but measurement precision deteriorates

Engineering Contradiction:
Improvelanguage variation handlingVSAvoidinterpretation accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The system merges data-driven machine learning models with rule-based processing frameworks. The data-driven component handles language variations and adapts to new expressions, while the rule-based component ensures precise interpretation and consistent logic. This combination achieves both adaptability to diverse language inputs and measurement precision in understanding accuracy.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

Different processing strategies are applied locally to different aspects of language understanding. Data-driven approaches are used for aspects requiring adaptability such as slang recognition and dialect handling, while rule-based methods are applied to critical interpretation tasks requiring high precision such as intent classification and entity recognition.

Inventive Principle:
Principle #3Local quality

3Manufacturing precision

If hand-crafted rules are used for natural language understanding, then manufacturing precision is improved, but ease of manufacture deteriorates

Engineering Contradiction:
Improvenatural language understanding precisionVSAvoidsystem development ease
Core Design Contradiction:
Manufacturing precisionVSEase of manufacture

Solution Approach 1:

The system performs preliminary actions by automatically generating and pre-processing large volumes of training data and language examples before the main NLU system deployment. This preliminary data preparation and annotation work enables the rule-based system to achieve high precision without requiring extensive manual rule crafting during system development.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements self-service mechanisms where the system automatically generates training data, performs self-annotation, and iteratively improves its own rules through feedback from actual usage. This reduces the need for continuous manual rule crafting and system re-development, improving ease of manufacture while maintaining high understanding precision.

Inventive Principle:
Principle #25Self-service

4Productivity

If automated machine learning is used for conversational applications, then productivity is improved, but reliability deteriorates

Engineering Contradiction:
Improvesystem development speedVSAvoidsystem behavior predictability
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system incorporates feedback loops where automated machine learning models are continuously evaluated against ground truth data and user interactions. Performance metrics are monitored and fed back into the training process, allowing the system to maintain high productivity through automation while improving reliability over time through iterative refinement and validation.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent implements beforehand cushioning by incorporating validation layers, confidence threshold checks, and fallback mechanisms before automated machine learning decisions are finalized. These protective measures ensure that even as development speed increases through automation, the system maintains reliable and predictable behavior by catching and correcting potential errors before they affect user experience.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

Data Source

PatentUS10068174B2Hybrid approach for developing, optimizing, and executing conversational interaction applications
Publication Date: 2018.09.04 ARTIFICIAL SOLUTIONS
  • US10068174B2 patent drawing
  • US10068174B2 patent drawing
  • US10068174B2 patent drawing

AI summary

A system for hybrid approach to natural language understanding is provided, comprising a machine learning configured to create a new natural language understanding model from user-provided examples, and provide a natural language understanding model dataset to other components of the system; an integrated development environment configured to retrieve the natural language understanding model dataset, and publish a hybrid runtime solution; and an interaction engine configured to: retrieve the hybrid runtime solution, receive a natural language input, and process the natural language input and generate a log dataset; wherein, the log dataset may be used to retrain and improve existing models.