Natural Language Engine Constraint-Based Sentence Structure Selection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Natural language generation systems often produce unnatural and incorrect responses to verbal queries due to the inability to effectively transform knowledge base triples into coherent, natural-sounding sentences.

Innovation Solution

A method that involves mapping user queries to structured data from a knowledge base, identifying appropriate sentence structures with constraints, and communicating the output as a natural language sentence only when the constraints are satisfied, using a natural language engine with processors and computer-storage media to generate valid and natural-sounding responses.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If knowledge base triples are transformed into natural language sentences using standard templates, then the output is grammatically correct and structured, but the sentences sound robotic and unnatural

Engineering Contradiction:
Improvegrammatical correctnessVSAvoidnatural sound quality
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system changes parameters by introducing multiple alternative sentence structures (templates) with varying levels of formality and complexity. Instead of using a single rigid template, the system selects from multiple templates based on the context, transforming the output from robotic to natural-sounding while maintaining grammatical correctness.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system makes the sentence generation dynamic by selecting different sentence structures based on contextual factors such as the type of triple, the domain, and the desired tone. This dynamic selection allows the output to adapt to different situations, making it sound more natural while preserving grammatical accuracy.

Inventive Principle:
Principle #15Dynamics

2Ease of operation

If multiple sentence structures are used to improve naturalness, then the output becomes more natural-sounding, but the system complexity increases

Engineering Contradiction:
Improvenatural sound qualityVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system segments the sentence generation process into distinct components: triple parsing, template selection, constraint checking, and sentence assembly. Each component handles a specific aspect of the generation process, making the overall complex system manageable and maintainable while producing natural-sounding output.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary actions by pre-defining multiple sentence templates with associated constraints before runtime. This allows the system to quickly select and apply appropriate templates during query processing without generating complexity during execution, as the structural decisions are made in advance.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If sentence structures with constraints are implemented to ensure correctness, then the output accuracy improves, but the generation process becomes more complex

Engineering Contradiction:
Improveoutput accuracyVSAvoidgeneration process complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system implements feedback mechanisms through constraint checking, where each selected sentence template is validated against a set of constraints before final output. This feedback loop ensures that only sentences meeting the required accuracy standards are generated, while the modular constraint checking process keeps the complexity manageable.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9542928B2Generating natural language outputs
Publication Date: 2017.01.10 MICROSOFT TECHNOLOGY LICENSING LLC
  • US9542928B2 patent drawing
  • US9542928B2 patent drawing
  • US9542928B2 patent drawing

AI summary

Methods, computer systems, and computer-storage media are provided for generating natural language outputs. Sets of triples may be used to map voice queries and answers to sentence structures that may be used as an output answer to the voice query. Sentence structures are only appropriate with certain sets of triples. One or more constraints may be associated with the set of triples to make sure sentence structures are only applied in correct situations. In order to be a valid sentence structure, each constraint associated therewith must be satisfied. If each constraint is satisfied, the sentence structure is valid and may be used as the format for an output answer. If each constraint is not satisfied, additional sentence structures associated with the set of triples may be evaluated until a valid sentence structure is identified. If no sentence structure is valid, no output is generated.