Natural Language Generation via Sentence Adaptation Operators

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional language generation systems are limited in producing a large variety of grammatically correct sentences, making them less user-friendly, as they require linguistic sophistication, are tied to database volume, or produce only limited responses.

Innovation Solution

A method that retrieves and adapts stored sentences with similar semantic features, using adaptation operators to generate grammatically correct output, where the adaptation cost is calculated to ensure efficient production of natural language responses.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If template-based systems are used, then ease of development is improved, but variety of responses is limited

Engineering Contradiction:
Improveease of developmentVSAvoidvariety of responses
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The system segments the sentence generation process into multiple components: retrieving base sentences from a database, identifying adaptation operators (substitution, deletion, insertion, movement), and applying these operators to generate varied responses. This segmentation allows the system to maintain ease of development through database storage while achieving high response variety through combinatorial adaptation operations.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically adapts retrieved sentences by applying different adaptation operators based on the current query and context. The adaptation cost calculation dynamically selects the most appropriate operators, allowing the same base sentence to produce multiple varied responses depending on the query requirements, thus resolving the contradiction between ease of development and response variety.

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If rule-based systems are used, then versatility is improved, but requirement for linguistic sophistication increases

Engineering Contradiction:
ImproveversatilityVSAvoidrequirement for linguistic sophistication
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

Instead of creating complex rules from scratch, the system copies and adapts existing sentences from a database. The adaptation operators (substitution, deletion, insertion, movement) modify these copied sentences to fit different query requirements. This approach achieves versatility through adaptation rather than through complex linguistic rules, reducing the requirement for linguistic sophistication.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system discards the need for complex linguistic rules and recovers from the database of existing sentences. By retrieving base sentences and applying adaptation operators, the system recovers the necessary linguistic complexity from stored examples rather than requiring it to be programmed explicitly, thus reducing the burden on developers with linguistic expertise.

Inventive Principle:
Principle #34Discarding and recovering

3Reliability

If statistics-based systems are used, then performance is improved with large database volume, but initial database requirements increase

Engineering Contradiction:
ImproveperformanceVSAvoiddatabase volume
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The system performs preliminary action by retrieving and pre-processing sentences from the database before generating responses. The adaptation operators are prepared and selected based on the query type, allowing the system to achieve good performance with a smaller effective database. The preliminary retrieval and adaptation planning reduces the need for extremely large databases compared to purely statistics-based approaches.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system changes the parameter of sentence generation from purely statistical probability to a hybrid approach incorporating adaptation operators and semantic similarity thresholds. This parameter change allows the system to achieve reliable performance by focusing on quality of adaptation rather than quantity of training data, thus reducing initial database volume requirements while maintaining good performance.

Inventive Principle:
Principle #35Parameter changes

4Ease of manufacture

If conventional systems are used, then development is simplified, but ability to produce grammatically correct output is limited

Engineering Contradiction:
Improvedevelopment simplicityVSAvoidgrammatical correctness
Core Design Contradiction:
Ease of manufactureVSManufacturing precision

Solution Approach 1:

The system incorporates feedback through adaptation cost calculation, which evaluates the likelihood that applying an adaptation operator will produce a grammatically correct sentence. This feedback mechanism guides the selection of adaptation operators to prioritize grammatical correctness while maintaining development simplicity through automated cost evaluation rather than manual rule creation.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system replaces complex mechanical rule-based grammatical generation with a database retrieval and adaptation approach. Instead of using complex grammatical rules (mechanical system), the system retrieves base sentences and applies adaptation operators that preserve grammatical structure, achieving grammatical correctness through adaptation rather than through complex grammatical mechanics.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS7496621B2Method, program, and apparatus for natural language generation
Publication Date: 2009.02.24 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US7496621B2 patent drawing
  • US7496621B2 patent drawing
  • US7496621B2 patent drawing

AI summary

One embodiment of the present method, program, and apparatus for natural language generation enables a language generation system to generate a grammatically correct natural language sentence by retrieving and adapting one or more stored sentences having semantic features similar to semantic features of a system-generated semantic representation. The retrieval of stored sentences is guided at least in part by the ease with which the stored sentences may be adapted to produce a grammatically correct sentence, enabling rapid generation of accurate output.