Semantic Re-ranking Module for Dialogue Context Sharing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conversational dialogue applications face challenges in understanding and managing context, leading to errors in recognition and reasoning, as existing systems operate in a context-less mode, failing to effectively utilize dialogue history, visual cues, and world knowledge for improved natural language processing.

Innovation Solution

Implementing a human-machine dialogue arrangement with multiple computer-implemented components that share context information using key-value pairs, enabling semantic re-ranking of NLU results and resolving anaphora through linguistic cues, dialogue context, and general knowledge, with an anaphora processor that accesses various information sources to identify and resolve ambiguities.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a natural language understanding component is added to extract semantic meaning from input queries, then the system's ability to understand user intent is improved, but the complexity of the system increases

Engineering Contradiction:
Improveunderstanding accuracyVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system is divided into distinct modular components: ASR engine for speech-to-text conversion, NLU engine for semantic interpretation, dialogue manager for context management, and client for interface handling. Each component performs a specific function and can be independently optimized, maintained, and scaled, reducing overall system complexity while maintaining understanding accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A dialogue manager acts as an intermediary component that receives semantic interpretations from the NLU engine and manages context information. This mediator coordinates between the NLU component and other system elements, simplifying the overall architecture by centralizing context management and reducing direct dependencies between components.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If context information is shared between dialogue components using a common mechanism, then recognition and reasoning errors are reduced, but the complexity of information management increases

Engineering Contradiction:
Improverecognition accuracyVSAvoidcontext management complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

A universal context sharing mechanism is implemented that serves multiple dialogue components (ASR, NLU, dialogue manager) simultaneously. This single context management system handles belief states, expectation agendas, and dialogue focus for all components, reducing the need for separate context management systems and simplifying information flow while improving recognition accuracy through consistent context access.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The context sharing mechanism implements feedback loops where each dialogue component updates the shared context with its findings and receives updated context information. The dialogue manager continuously updates the belief state based on user inputs and system responses, and this updated context is fed back to the NLU engine for improved interpretation of subsequent utterances, reducing reasoning errors through iterative refinement.

Inventive Principle:
Principle #23Feedback

3Measurement precision

If semantic re-ranking is performed using dialogue context and world knowledge, then the accuracy of semantic interpretations is improved, but the processing time increases

Engineering Contradiction:
Improvesemantic interpretation accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

World knowledge and dialogue context are pre-processed and stored in structured formats (knowledge bases, context databases) before being needed for semantic re-ranking. This preliminary preparation allows the system to quickly retrieve and apply relevant information during the re-ranking process without performing complex computations in real-time, thus improving accuracy while minimizing processing time delays.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9269354B2Semantic re-ranking of NLU results in conversational dialogue applications
Publication Date: 2016.02.23 MICROSOFT TECHNOLOGY LICENSING LLC
  • US9269354B2 patent drawing
  • US9269354B2 patent drawing
  • US9269354B2 patent drawing

AI summary

A human-machine dialog system is described which has multiple computer-implemented dialog components. A user client delivers output prompts to a human user and receives dialog inputs from the human user including speech inputs. An automatic speech recognition (ASR) engine processes the speech inputs to determine corresponding sequences of representative text words. A natural language understanding (NLU) engine processes the text words to determine corresponding NLU-ranked semantic interpretations. A semantic re-ranking module re-ranks the NLU-ranked semantic interpretations based on at least one of dialog context information and world knowledge information. A dialog manager responds to the re-ranked semantic interpretations and generates the output prompts so as to manage a dialog process with the human user.